write batch metadata to flat files since we're not using PG