Suspected Al-Qaeda militants launched a rocket and car bomb attack on an army headquarters in Yemen's main southern city of Aden on Wednesday killing four people, a security official said.