It's our male hormones (called androgens), as well as our overall hormonal balance, that stimulate growth of chin hair, she explains. Depending on how sensitive your hair follicles are to these hormones, you may sprout more or less of them.