Hair loss in men is primarily caused by genetic factors, hormonal changes (especially DHT), and certain medical conditions like alopecia.