While it is true that some people seem to outgrow their anxiety as they age, there is no guarantee that this will happen to everyone. In fact, for some people, stress may worsen with age. Many factors, such as increasing life stressors, health problems, and losses, can contribute to this.