HPCC-9572 - Fix hash dedup row leak after spill event

When hash dedup spills, it continues to use the bucket hash tables
for dedupping purposes. The memory manager callback to flush
the HT was not protected by a mutex, which meant the reset could
overlap with another thread adding new rows, causing the flush to
in effect lose those newly added rows.

Also, close all bucket spill streams at end of phase (instead of
waiting for each new level to start). Minor significance, but the
output streams will have some buffered rows, and it is better to
close and flush those out upfront, rather than leave them in memory
whilst the other phases are being handled.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-9605 - Remove spurious 20s sleep at slave start

Introduced accidentally as part of HPCC-8669 changes

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Merge pull request #4580 from jakesmith/hpcc-9605

HPCC-9605 - Remove spurious 20s sleep at slave start

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9606 Update doc images in Tech Prev

Signed-off-by: g-pan <greg.panagiotatos@lexisnexis.com>
Merge pull request #4584 from g-pan/H9606-TchPrvImg

HPCC-9606 Update doc images in Tech Prev

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9341 Add ecl-publish support for suspend and delete previous

Adds command line support for suspending or deleting the previously
active query when publishing and activating a query.

Signed-off-by: Anthony Fishbeck <Anthony.Fishbeck@lexisnexis.com>
Merge branch 'publishDeletePrevious9341' into candidate-4.0.0

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9587 Ubuntu 12.04 32bit eclcc cores on constant folding

Seems like we can end up with additional instructions between
the two asm sections that rely on the value of esp having been
already restored.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #4581 from richardkchapman/32-bit-fold-core

HPCC-9587 Ubuntu 12.04 32bit eclcc cores on constant folding

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
HPCC-9612 Roxie is ignoring slaveThreads setting

The refactoring of roxie topology in rc13 introduced a regression where the
roxieSlaveThreads setting would be ignored, and only one slave thread would
be allocated.

This could lead to lockups in cases where a slave thread tried to make remote
calls, such as sqfilt.ecl in the regression suite.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #4587 from richardkchapman/roxie-slave-threads

HPCC-9612 Roxie is ignoring slaveThreads setting

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
HPCC-9594 Rembed fails in thor

Thor plugin checking mechanism is over-sensitive.

The whole area really needs some refactoring, but for now simplest fix is
to disable the failing checks, thus bringing thor behaviour in line with other
components.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9570 SOAPCALL returning "Request too large for buffer fragment"

If a SOAPCALL service returns chunked data and any chunk is larger than
64K, an error is reported and the data transfer is aborted.  This fix
allows chunks of any size by removing the size check

Signed-off-by: William Whitehead <william.whitehead@lexisnexis.com>
Merge branch 'soapcall' into candidate-4.0.0

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9609 - Tidy up dataLinkStart calls

Unecessary calls passing in activity string/id, when CThorDataLink
already had activity with same info.

Also resolve a uninitialized warning picked up by Valgrind.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-8804 New ECL Watch homepage

Add new Activity page.
Add new Search Results page.
Enhance ensureNavLink to allow opening in a new page.
Add links to legacy pages.

Fixes HPCC-8804

Signed-off-by: Gordon Smith <gordon.smith@lexisnexis.com>
HPCC-9611 Can't run more than one thor job that uses Java

The libjavaembed plugin does not operate correctly if loaded and unloaded
(this is due to JVM limitations).

This does not cause issues for Roxie or hThor, but thor loads referenced
plugins per job, and will thus fail the second time a job references java.

Rather than refactor the (obsolete) plugin mechanism to allow indication of
'keep loaded' status, add code into the plugin itself to 'leak' a reference in
order to prevent it from unloading after having been loaded for the first
time.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #4586 from richardkchapman/java-embed-stay-loaded

HPCC-9611 Can't run more than one thor job that uses Java

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Merge pull request #4582 from GordonSmith/HPCC-8804

HPCC-8804 New ECL Watch homepage

Reviewed-By: Miguel Vazquez <miguel.vazquez@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #4588 from richardkchapman/thor-plugin-checks

HPCC-9594 Rembed fails in thor

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>