Having a credit card with a high interest rate will not negatively impact your credit or your finances if you’re not carrying a balance. So, simply having a high interest rate is not a reason, in and of itself, to close a credit card. But if you have a balance on a credit card with a high interest rate, you might want to consider doing a balance transfer to a card with a promotional 0% interest rate while you work to pay it off.