revise crawl: finally, no dups; condense/flush I/O