For some men, male pattern baldness can aggressively kick in right after puberty around the ages of 18-20, causing visible and significant balding even before the age of 20.