The best time to start taking withdrawals depends on your personal circumstances. Generally, you can start withdrawing from your 403(b) at age 59½ without penalty, and you can begin claiming Social Security benefits as early as age 62, though waiting can increase your monthly benefit.