updated for batch processing, utilities & analytics