major refactor to add batch job base class
and allow long running jobs on the local worker

more to debug and test...but all rspec tests pass
max_slice -->  batch_size