Simplify worker to be multi-threaded

Signed-off-by: Julien Danjou <julien@danjou.info>