More refactoring, Dirscanner is now DirScanWorker.

Added 'options' to call chain from Pipeline, through Job down to Worker
methods, for future use for such things are debug options etc. Also
added ruby debugger gem.