His great-grandfather, Alexander Magruder, had come to Prince George's County, Maryland in 1652 after having been deported from Perthshire, Scotland where he was an indentured servant pursuing the Scottish Rebellion. He was the son of John and Susanna Magruder, and the grandsons of Samuel and Sarah Magruder. Most of the Magruders in America were farmers, merchants and mechanics.