Fraser was the eldest of four children of George Robbins Fraser, a barrister, and Elizabeth Allen Smythe. He was educated at Victoria College, Jersey and the Royal Military Academy, Woolwich, from where he was commissioned into the Royal Engineers in 1862. Following postings in France and Bulgaria, he served as the Political Secretary to Sir Evelyn Wood during the First Boer War. For his service in this conflict he was made a Companion of the Order of St Michael and St George. He served the Anglo-Egyptian War in 1882 and was twice mentioned in dispatches, and promoted to Major and then Lieutenant-Colonel while serving with the Egyptian Army. He was again mentioned in dispatches, promoted to full Colonel and appointed a Companion of the Order of the Bath, before a period of service in England. Fraser was knighted in the 1900 Birthday Honours and placed on retired pay in 1902.