Yes, you will get your deposit back when you graduate to an unsecured credit card or when you decide to close your Discover secured card and have paid up everything.