You may, if the deposit is refundable. Typically, you need to make on-time payments for six months or longer to have a secured credit card deposit refunded to you.