When you shouldn't close your credit card. Canceling a credit card — even one with zero balance — can end up hurting your credit score in multiple ways. A temporary dip in score can also lessen your chances of getting approved for new credit.