finished up basic work on ingest, verification, and batch processing