Province of Pennsylvania
Miller was descended from Irish American immigrants who settled in the Province of Pennsylvania in the colonial era. His father, Matthew Miller, was a volunteer in the Pennsylvania militia during the War of 1812.