Yes, you do have to return the payment. The law simply does not allow you to keep payments to which you are not otherwise entitled, such as payments for work if the work was never in fact done. If you don't voluntarily return it, they could sue you for the money and will win, so it is strongly in your interest to return it without litigation.