improving sweeper support for large number of input files
Changes to support new partitioning that produces fewer output files
Changes to support new partitioning that produces fewer output files
merged
adding priority queuing for sweeper
adding support for multiple priority levels in the sweeper code
removing unused imports