Alcohol, caffeine, added sugars, and refined carbohydrates can all contribute to increased anxiety levels. Alcohol can impact serotonin levels in the brain, while caffeine is a stimulant that can leave you feeling jittery and tense. Sugars and refined carbohydrates can affect blood sugar levels and gut health.