Changed tabs to spaces
(Hopefully) Fix looping bug

Hopefully fix looping bug where messages could be missed.
Added shard pieces

The shard directory is what needs to be copied to a processing node.
then can simply run cleanup_threaded.py to have it constantly loop.