backend api now requires the creation of a new session each time
ingestion is fully incremental, with additional stats