In general, no. Even if you're opening a credit card for a specific purpose, keeping the account open can help add resiliency to your credit report. The number of open accounts and age of open accounts both factor into your credit score.