Bitcoins are not kept in banks like your money, but in protected digital wallets on smartphones, computers or specially secured storage media. The digital wallet is encrypted and secured with a password. If a password is lost, the user will no longer be able to open the wallet.
Wallets can be stored offline (cold storage) or online at cryptocurrency exchanges, where Bitcoins are traded for traditional currencies or other cryptocurrencies.