You can retire with $1 million dollars if you manage your withdrawals appropriately. The Rule of 4 says that you should withdraw no more than 4% of your total portfolio each year. Assuming you’re earning at least 4% in returns, you can effectively live off of interest-earned without touching your principal balance. With a $1 million portfolio, this is $40,000 per year.