Remove unnecessary add/remove worker logic.