No, you will not lose your Cashback Vouchers if you cancel your card or if it got lost or stolen.
You can still get Cashback Vouchers when paying with your sKash app.