Muhammad Aziz Khan was born in Pallandri, Sudhanoti, Jammu and Kashmir in British India (Azad Kashmir, Pakistan) on 1 January 1947 to a Sudhan family. He first graduating from the High School Palandri, before joining the joined the Pakistan Army in 1964. He first completed his combat duty with the army during the second war with India in 1965, before being redirected to join the Pakistan Military Academy (PMA).