Born in Raleigh, North Carolina, in 1808, Johnson grew up in poverty. He was apprenticed to a tailor as a boy, but ran away. He opened a tailor shop in Greeneville, Tennessee, married Eliza McCardle, and participated in debates at the local academy.