Experts recommend having twice your annual salary in savings by the age of 40. But that applies to those planning to retire in their late 60s. If you want to retire at 40, you are gonna need to save more aggressively. Some studies put the average retirement costs at over $700,000.