BUG:1494 Wizard shouldn't put dali and sasha on same node

Modify genenvrules.conf to add dali-sasha to avoid_combo tag.
Prevent the wizard from generating a configuration where
dali and sasha are put on the same node.

Signed-off-by: Gleb Aronsky <gleb.aronsky@lexisnexis.com>
Initial work on supporting loop termination conditions

- Add a new flag and two new functions to provide ways of accessing the
  global whether to execute again condition without requiring the whole
  dataset in memory.

- Modify hthor and roxie so they can use the new functions

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Change memory size defaults + allow configurable

Allow the global pool to be configurable (per job) and allow it to be unbound,
IOW, allow it consume all available OS memory. Set to 0 to be unbound.
Allow 'largeMem' size to be configurable per job, and make it default to 75%
of global mem.
If global mem unset it will default to 75% of 2GB - this will change to
be automatically based on physical RAM and take into account slavesPerNode
in a future commit.

NB: largeMemSize setting was being completely ignored, due to a typo.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Significant improvement to generated code

- Instead of generating
  ROW(transform({bool value}, self.value := f(ds[1])));
  try and generate
  TABLE(ds, { bool value = f(LEFT); })[1]

  It tends to generate much better code.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #1626 from rengolin/dataset

Fix numRows check in hthor/thor engine for temp table

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Merge pull request #1715 from jakesmith/allocissue2

Change memory size defaults + allow configurable

Reviewed-By: Gavin Halliday <gavin.halliday@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #1716 from jakesmith/allocissue2

Change memory size defaults + allow configurable

Reviewed-By: Gavin Halliday <gavin.halliday@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Fixes gh-1718 Changed from awk with delim _ to bash expansions to
allow for component names with _ in them.

Signed-off-by: Philip Schwartz <philip.schwartz@lexisnexis.com>
Remove default memory setting values from thor.xsd

default for globalMemorySize is now unset, which means unbound
default for largeMemSize is 75% of globalMemorySize if set, or 75% of 2GB
(will become 75% of RAM / slavesPerNode shortly)

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Merge pull request #1725 from jakesmith/allocissue2

Remove default memory setting values from thor.xsd

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #1722 from jakesmith/allocissue2

Remove default memory setting values from thor.xsd

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #1723 from pschwartz/compNamespacing

Fixes gh-1718 Changed from awk with delim _ to bash expansions to

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #1721 from pschwartz/compNamespacing

Fixes gh-1718 Changed from awk with delim _ to bash expansions to
Add optimization to replace local sorts with grouped

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Optimization - use group sort if partially sorted

- Fix minor bug - NOSORT(RIGHT) ignored on a join
- Fix minor bugs with sort tracking in and out of groups.
- Improve display of local sort using group sort in graph.
- Improve graph meta for graph result reading.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Fix unused result on write warning
Throw string exception on stream, log on socket
catch block for writeBytes
Merge pull request #1720 from rengolin/warnings

Fix unused result on write warning

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #1605 from rengolin/warnings3

Fix unused result in remaining warnings

Reviewed-By: Gavin Halliday <gavin.halliday@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>