You can get rid of old bank statements that you no longer need. However, you want to dispose of them securely (often by shredding them) since they contain sensitive information.