minerloop_async: Break out of select on work_restart_notifier