we now keep extra information in the database in case of Full Ingestion failures - maybe I have to apply the same patter in incremental ingestion as well