+1 for batching jobs as well (e.g. 10000 documents at once) to hide the per-job execution overhead. Batching a large number of documents will also reduce the number of vocabularies to pass between process (they can be very expensive to unpickle as the keys will be re-hashed on the un-pickling side).