Add a configurable batch size option to the reindexer
Attempt to make error failures less sneaky and silent