Mace's military career began in the Taranaki Mounted Rifle Volunteers. At the Battle of Waireka on 28 March 1860 Mace's service as a dispatch rider drew a lot of attention. In July 1862 he was given a presentation revolver for his services during the battle. His bravery in numerous other engagements was widely acknowledged.