Merge pull request #990 from rcordovano/ingest_api_for_automation

Restore batching of ingest jobs via IngestManager API
Remove dead code from IngestManager and start refactoring
Refactor IngestJob and IngestManager in preparation for API work