After retiring from the military in 1980, Shariff was appointed as chairman of Federal Public Service Commission while he continued his role as military adviser to President Zia-ul-Haq until 1988 when he retired from public service. After living a quiet life in Islamabad, he announced the publishing of his memoirs, "Admiral's Diary", providing further accounts, causes, and failure of military crackdown in East Pakistan.