Stoney grew up at Greyfort House, Borrisokane, County Tipperary in Ireland. His grandfather, Thomas Stoney, had migrated to Ireland from Yorkshire, England, in the wake of the Williamite conquest of Ireland, 1689–91.