make it compile
new API for generator supporting progressive data generation;