Resilient indexers

Also: clean up configuration options, make re-indexing aware of individual backends, and add re-indexing completion estimates.