Removing worker from the known workers fixed

The worker wasn't removed properly from the known workers and remains there even after expiration. The patch fixes it.