He should refund the money.  He will not be liable for the work given the circumstances and the fact that the owner cancelled the contract despite the fact it is not in writing.