Just because horny goat weed is an herbal supplement doesn’t mean what you buy in a store is natural. Herbal supplements are not regulated by the FDA, so check the label for unexpected or added ingredients.