Yes, you can have a credit card against savings accounts. Banks offering secured credit cards require you to make a security deposit in a collateral account, which is generally a savings account. Secured credit cards require a cash collateral deposit which becomes the line of credit for that account.