@MikeSilvis I'd start with a guess at 100, assuming the overhead is going to reduce as ~1/batchsize.  It's probably not worth fine-tuning too much, given the variablility in the environments this gets used in, but comparing a benchmark with values of 10 and 1000 might be informative.