A distributed stream partition framework, designed to work with GB per second stream grouped by user defined criteria