After you make a security deposit for a secured credit card, the credit card company holds onto it. Generally, there are two ways you can get it back.The first way to get your deposit back is to graduate to an unsecured credit card. Your credit card company may review your secured card account periodically. If you’ve established a record of using your card responsibly, it may switch you to an unsecured card. In that case, your deposit will be refunded.The other way to get your deposit back is to close your account. To do so, you’d have to pay off your balance first. Otherwise, the credit card company could keep part or all of your deposit as payment. Closing a credit card can impact your credit score by reducing your overall credit utilization and decreasing your average length of credit history.