Do not check wakeup too often in try_to_freeze_tasks()