added support for batched processing so you can parse in batches and process