db retrieval size based on index batch size
log individual failures for a bulk operation