People with high blood pressure, ulcers, Crohn's disease, or ulcerative colitis should avoid consuming rosemary. In addition, pregnant women and lactating mothers should avoid it.