Baba is Hard, But Not For The Reason You Think...