Do not check wake up too often in try_to_freeze tasks()