delete all started batches if spider finished normally
set default HCF_MAX_CONCURRENT_BATCHES to 5 (for more frequent checkpoints)
minor tweaks