improvements for generator to allow generatorion of dense files