modified for max batch size of 1000 products