pre-final run of data collection commit