updates spec tests and batch_ingest