While you may simply be able to move your money to a different savings account and keep your current one open, this isn't always an option. Some banks have minimum balance requirements, meaning that if you withdraw all your money from the account, you'll no longer be able to keep it open.