Remove deprecated Worker struct

We split them into WorkerID and WorkerConnection.

Signed-off-by: Robert Xu <robxu9@gmail.com>