fixes for ingestion pipeline