Shut down async worker properly