HPCC-9589 Introduce pseudo tables flags for xml/nlp parse

These can be used instead of the current flags in the context.  However because
of issues with hoisting table invariants currently ignoring counters the
switch from the flags can't be done yet.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-9810 Add test case for transfer to/from unicode

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-9589 Remove colocal/parent extract from some child activities

If the child activity doesn't need to get anything from the parent activity
then it doesn't need a colocal or parent extract.  This can significantly
cut down the size of some queries (and simplify the classes).

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-9817 Fix issues comparing against a NULL unicode string

Strange as it may seem, the ICU compare functions check for NULL
pointers as parameters, and sometimes abort early giving the wrong result.
See http://sourceforge.net/mailarchive/message.php?msg_id=29406824 for
a similar issue.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-9825 ECL Watch Nested Dataset Result Corruption

Rows with a single item would not be treated as an array.

Fixes HPCC-9825

Signed-off-by: Gordon Smith <gordon.smith@lexisnexis.com>
HPCC-9785 - Optimize the parallel and unsorted join helpers

The multi threaded join helpers were very inefficient in
processing the match/transform of groups and delivery the
results to the output.

The main 2 changes are:
1) Ensure each thread has it's own allocator, to avoid heavy
contention in the memory manager
2) Implement an efficient interface for multiple threads to
write to and a reader read from (a pipe with multiple writers).
This avoids heavy contetion and delays on mutexs and semaphores
that was being hit inside SimpleInterThreadQueueOf

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Changes folowing review and further testing

+ Add joinHelper_threads option
+ Add granularity, num threads and limit options
+ Correct a comment
+ Change when CThorSpillableRowArray::flush shuffles ptr array,
with behaviour here, it could cause the row array to keep growing
leaving lots of empty space behind it.
+ Fixed a couple of issue if aborting
+ add array appendRows method for efficiency and clarity
+ add a regression test joinmulti.ecl

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-9826 Update to dojo 1.9.1

Also add D3/TopoJson library.

Fixes HPCC-9826

Signed-off-by: Gordon Smith <gordon.smith@lexisnexis.com>
improve transferRowsCopy
Change a break; to a return; for clarity

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Merge pull request #4692 from jakesmith/hpcc-9785

HPCC-9785 - Optimize the parallel and unsorted join helpers

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
HPCC-9839 Fix regression failing to check crcResources option

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #4737 from ghalliday/issue9839

HPCC-9839 Fix regression failing to check crcResources option

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Community Edition 4.0.0-8 Gold

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge remote-tracking branch 'origin/candidate-4.0.0' into candidate-4.0.2

Merged-by: Gavin Halliday <ghalliday@hpccsystems.com>
Merge remote-tracking branch 'origin/candidate-4.0.2'

Merged-by: Gavin Halliday <ghalliday@hpccsystems.com>
HPCC-9857 Configmr - Crashes if referencing a missing HW node

Signed-off-by: Gleb Aronsky <gleb.aronsky@lexisnexis.com>
HPCC-9854 Enable prototyping in JSBin

Fixes HPCC-9854

Signed-off-by: Gordon Smith <gordon.smith@lexisnexis.com>
HPCC-9840 Allow "Open in New Page" for each details page.

Fixes HPCC-9840

Signed-off-by: Gordon Smith <gordon.smith@lexisnexis.com>
HPCC-9821 Allow raw HTML + JavaScript in result cells

Fixes HPCC-9821

Signed-off-by: Gordon Smith <gordon.smith@lexisnexis.com>