If someone uses their credit card statements to help them figure out tax deductions, they should keep old credit card statements for up to seven years. That way, if the IRS has questions about their deductions, they can have the documentation to back them up.