Hair loss in men can start as early as the late teens, although it's less common at this age. Factors such as chronic illness, stress, certain medications, and genetic predisposition can contribute to early onset hair loss.