updated ingest further to be smarter, added more to config