Correctly revoke slots from the task tracker