Merge latest changes from candidate-3.6.x into candidate-3.6.2

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Community Edition 3.6.2 Release Candidate 3

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Better handling of out of memory reallocating a buffer

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge latest changes from candidate-3.6.x to candidate-3.6.2

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Allow ERROR(ds, FAIL...) as well as FAIL(ds, FAIL...)

Fixes bugzilla #100249

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Mark left dataset of join sorted even if global

Previously the function to indicate that the left hand side of a join
was sorted was never set for a global join.  However thor does correctly
support it if the dataset is globally sorted.
Also add flags to indicate if left/right are locally sorted to
potentially avoid some work in the sorting.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge latest changes from candidate-3.6.x to candidate-3.6.2

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Community Edition 3.6.2 Release Candidate 4

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
gh-1918 - Fix dali backupComputer issue

If the intermediate paths of the mirror path on the comupter specified by
backupComputer didn't exist. Dali would fail to create the dali backup
direcotry and cause dali to fail to start

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Merge pull request #2027 from jakesmith/gh-1918

gh-1918 - Fix dali backupComputer issue

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Merge latest changes from candidate-3.6.x to candidate-3.6.2

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Meta informaiton for a loop/graph was wrong

Meta information for a loop was based on the input dataset, instead of
the intersection of the input dataset and the result of the loop.
Could potentially cause some optimizations to occur (e.g., removing
sorts/making local) which weren't always valid.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
gh-2024 - Move thor base ports, to avoid clash

Multislave configurations with eclagent on same box, could if unlucky use
clashing ports. The thor slave ports are fixed, but the agent dynamically
allocated ports between 6700-6999

Also, cleared up a few unused port definitions

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Fix #2029 internal error optimizing max(fetch(),x)

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
added ldap config info to installing and running doc

Signed-off-by: G Panagiotatos <g.pan3.14@gmail.com>
added user security section info to installing and running doc

Signed-off-by: G Panagiotatos <g.pan3.14@gmail.com>
gh-1832 Fix Deleting a workunit should remove from queues

This addresses an external users issue.  This shouldn't happen unless
the workunit state is no longer active, but it is somehow stuck in
the queue.

To test, one can simulate the issue by stopping the cluster, queueing
a workunit, setting the state to failed, then deleting the workunit.

Fixes gh-1832.
Signed-off-by: Anthony Fishbeck <Anthony.Fishbeck@lexisnexis.com>
gh#2043  Added section about backing up data including use of backupnode to Data Handling manual

Signed-off-by: JamesDeFabia <James.Defabia@LexisNexis.com>
Fix don't delete published workunits

Signed-off-by: Anthony Fishbeck <Anthony.Fishbeck@lexisnexis.com>
Fix WsWorkunits incorrectly showing delete was successful

Also made minor changes to thrown exceptions for consistency.

Signed-off-by: Anthony Fishbeck <Anthony.Fishbeck@lexisnexis.com>