Stressful events that take place during childhood, adolescence, or adulthood are frequently the cause of anxiety disorders. Being exposed to stress and trauma when you're very young is likely to have a significant effect.