Genetics are the main cause of a patchy beard. Additionally, low hormone levels such as testosterone or excessive levels of dihydrotestosterone (DHI) can also cause limited beard growth. Alopecia Areata, although not so common, can also lead to baldness in your cheek area.