Do not quit thread when setting new worker