hpcc-systems/HPCC-Platform — pull request #2192 by jakesmith (2012-04-30 14:05:50+00:00)
Title: Switch Thor to RoxieMM and use new swapping paradigm

+group/local sort merged
- group sort now spills
- an overflowing local sort, used to spill last mem's worth unecessarily
+global sort, either all in mem, or all on disk.
- refactored out minisort and overflow intercept handling for clarify
+local join, used to spill both sides unconditionally
+globaljoin, each side either all in mem or disk. It still unecessarily
spills first side to disk before gathernig other side (TODO)
+Spillable streams, consuming or shared, retain rows in mem. until need to spill. Used by various things.
+Unified the array classes, will be easier to add spilling elsewhere now, e.g. extend hashdedup.

Signed-off-by: Jake Smith