Modify scheduler for new Worker structures, also add termination channel.

Signed-off-by: Robert Xu <robxu9@gmail.com>