When Willis was fourteen, his older brother William was arrested for antislavery agitation and thrown into jail. He escaped and fled to Canada, but the incident marked the Hodges family as pariahs in Princess Anne County. The young Hodges found himself the victim of mob violence on more than one occasion during this time. In the aftermath of the Nat Turner rebellion, the white legislature passed severe discriminatory measures against free blacks, fearing more uprisings.