multi-threaded ingest