touchwake: Fix issue that touch remains unpowered after late_resume

Thanks to Bponury

Signed-off-by: Stratos Karafotis <stratosk@semaphore.gr>