Because that's when people get to vote. Suffrage has long been tied to adulthood and the age of majority in the United States. Before the passage of the 26th Amendment in 1971, 21 was the minimum voting age in most states—and thus served as the age of adulthood in most areas of law.