Being frequently yelled at as a child can even impact how we think and feel about ourselves in adulthood. In fact, being yelled at increases the activity of the amygdala in the brain. Studies show that an overactive amygdala can cause stress, which plays a significant role in developing depression.