Caffeine in large amounts in coffee, chocolate, tea, and energy drinks can cause stress and anxiety. If caffeine makes you jittery and anxious, consider cutting it out.