High stress, traumatic events, phobias, a family history of anxiety disorders, and big life changes can cause panic attacks. For vulnerable people, caffeine, nicotine, and some drugs can cause panic attacks.