better logging information related to number of records skipped and processed as searchdocs