HPCC-3326 Thor Lookup Join improvements

Lookup join gathers the RHS into an expanding row array, then exapands that
row array to fit a proportianally sized hash table in at the end.
Change so that:

1) The hash table is a separate allocate, this a) means it's not requiring
and even bigger contiguous single array and b) the initial row array can be
released after hashing
2) If the input row count is known, pre-allocate the hash table
3) The broadcasting/collection of RHS was very inefficient. It involved
compressing blocks on all nodes, node 1 requesting them serially,
uncompressing, collecting into HT, recompressing and broadcasting back to
others.
Change scheme, so streams and broadcasts from all and keeps blocks
compressed until arrive at final destination

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-2197 Ecl package command line parameters need to be more consistent

The same parameters for different actions should be spelled
the same and should be consistent with ecl command line parameters
when applicable.  Required parameters should not be listed as optional
(i.e. target has replaced queryset and is required)

Signed-off-by: Stuart Ort <stuart.ort@lexisnexis.com>
HPCC-3365 Add params for per-query memory and time limits from CLI

Signed-off-by: JamesDeFabia <James.Defabia@LexisNexis.com>
HPCC-7916 Add ecl roxie commands

Signed-off-by: JamesDeFabia <James.Defabia@LexisNexis.com>
HPCC-7888 Ensure query dlls in separate dir

In multi slave setups, the query dll must not clash.
Ensure it's in it's own directory.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Split off closedown branch for 3.8.6

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Split off closedown branch for 3.8.6

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-7882 Update docs to reflect changes to ecl CLI

Signed-off-by: JamesDeFabia <James.Defabia@LexisNexis.com>
HPCC-2197 Ecl package command line parameters need to be more consistent

Code changes based on code review comments

Signed-off-by: Stuart Ort <stuart.ort@lexisnexis.com>
HPCC-2197 Ecl package command line parameters need to be more consistent

Usage section needs to have ecl package not ecl packagemap

Signed-off-by: Stuart Ort <stuart.ort@lexisnexis.com>
HPCC-7861 Fix field xpath('') causing invalid XML

In ECL an xpath('') has a special meaning indicating that the
content of the field should be output without a tag surounding it.

Currently an xpath('') is producing an invalid outter tag of <></>.

Output:
CONTENT

Rather than:
<tag>CONTENT</tag>

Signed-off-by: Anthony Fishbeck <Anthony.Fishbeck@lexisnexis.com>
Merge pull request #3424 from afishbeck/blank_xpath3.8.6

HPCC-7861 Fix field xpath('') causing invalid XML

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge branch 'CLI_params_3365' of https://github.com/JamesDeFabia/HPCC-Platform into JamesDeFabia-CLI_params_3365

Conflicts:
	docs/HPCCClientTools/CT_Mods/CT_ECL_CLI.xml

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-7934 Disable udpResendEnabled by default

It's not clear there is any benefit from this code in most situations, and there
is at least one outstanding issue HPCC-3028 - as yet unreproduced - where it
seemed to be cuaseing a core under load.

Disable by default until proven to work and help.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #3434 from richardkchapman/JamesDeFabia-CLI_params_3365

Merge Jim's doc changes

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
HPCC-633 Add support for loopagain support

Add support for LOOP, where the condition is on a dataset

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-2804 Inline dataset_from_transform

Inlines DATASET(count, TRANSFORM(COUNTER)) expressions when possible.

Signed-off-by: Renato Golin <rengolin@hpccsystems.com>
HPCC-2804 Continue to hoist no_dataset_from_row to reduce impact

With the previous change to inline no_dataset_from_row it also had the
side-effect of reducing the occasions when that operation was hoisted
to a more efficient context.  This change avoids that.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #3438 from rengolin/regressions

HPCC-7935 Use temp_files for regression temp dir

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #3411 from jakesmith/multislave-queryso-3.8.x

HPCC-7888 Ensure query dlls in separate dir

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>