Yes, if you use the Current Account Switch Service. This is a free service that takes care of transferring all your payments and your balance to your new account, while your old bank will close your old account. You can also close your old account manually if you prefer, just by getting in touch with your bank.