due to memory constraints on larger datasets, break up the batch creation into N_BULK_CREATE batchs