Tidy up partitioning stream
sketched out the compacting behaviour