Although rare (less than 1% of the population), some people can be allergic to milk thistle. Common allergic reactions include itchy skin, hives, and swelling of the face. If you are considering taking milk thistle, it may make sense to take an allergy test before you begin supplementation.