framework for processing streamcorpus data