better logging and ingestion