While there isn’t much evidence to say whether or not ashwagandha causes dry skin, it does appear that this supplement might help with some of the problems associated with having too much sebum production. In general, though, most dermatologists recommend steering clear from any sort of supplement if you are looking to treat your existing acne.