Yes. When you close your account with your old supplier, they will send you a final bill. Once this payment has gone out of your account, you should cancel your Direct Debit. If your account is in credit, the supplier should send you the balance.