Age, race, education, location, housing, and marital status are key factors that influence the average net worth.