People who are about to have surgery should not have a cup of chamomile tea with lavender, according to Web MD. They also advise pregnant women, those taking sedatives, and folks who are allergic to flowering plants.