Closing your credit card will hurt two categories of your credit score: your average age of credit and your credit utilization ratio. The level of impact on your credit score depends on how many other credit cards you have. If you have many more credit cards, closing one won't have as much of an effect as it would if you only have one other credit card.