improvements in index.clj
first attempt to report the progress of indexing