HPCC-11640 Use new --exception-level=warning option to ignore extra logging

Add new option to generated command

Strip <Info> lines from key files.

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-10684 Ensure old tracked session is removed from new

If an old session was being handled in stopSession, when a new
session (on same IP:port) started, the new session tracked the
old, but the old did not correctly remove itself from the current
state when it had finished stopping.

The consequence was that when the new came to stop at a later
point, it still had the old session tracked and tried [again]
to stop it again and instead of new.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11679 Catch exception in connection destructors

Avoid problems with exceptions being generated during clearup,
that causes problems if clearing up to handle an original exception.
Catch exception in connection beforeDispose and generate a log entry
only.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11640 Use new --exception-level=warning option to ignore extra logging

Update after review

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
Merge pull request #6058 from AttilaVamos/HPCC-11640-fix

HPCC-11640 Use new --exception-level=warning option to ignore extra logging

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
HPCC-11687 Fire exception on connect if from stale client

Fire an an abort exception, if connections received from an old
session (since Dali has recycled)

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11660 DOCS:Add System Admin guide to Doc. Set

Fix HPCC-11660 DOCS:Add System Admin guide to Doc. Set
Add System Admin Doc to HPCC document set
Also adding the structures to enable
automate building.

Signed-off-by: g-pan <greg.panagiotatos@lexisnexis.com>
HPCC-11688 unused-files shouldn't check packagemaps active on other roxies

Packagemaps used need to be associated with a target that is loaded on the
given roxie process cluster.

Signed-off-by: Anthony Fishbeck <anthony.fishbeck@lexisnexis.com>
HPCC-11485 Return same data in WsDFU/DFUQuery and DFUFileView

For each logical file, both WsDFU requests should return the same
data. In this fix, both WsDFU methods call the same function to read
logical file information. The function is enhanced to handle both
WsDFU requests.

Signed-off-by: wangkx <kevin.wang@lexisnexis.com>
HPCC-11157 Allow install-cluster run concurrently

1) Original install-cluster.sh is divided to two files:
  1.1) install-cluster.sh:
       1.1.1 ) top level script.
       1.1.2 ) get admin user passwords.
       1.1.3 ) create package for remote install
       1.1.4 ) excute install-hpcc.exp through cluster_script.py if python 2.6+ detected.
               It allows mulitple instances run simultanously. If no suitable python
               installed install-hpcc.exp will execute sequentially for each ip.

  1.2) install-hpcc.exp
       1.2.1) run on each host to install and configure HPCC.
       1.2.2) check connection logic is added. If it fails no furhter action will be
              applied on the host.
       1.2.3) Add handling ssh/scp connection without password which is normal in cloud
              environment.
2) The original script only install if hpcc user doesn't exists on the host. The fix
   lefts the restriction to allow installation always go through. If HPCC exists and the
   image version is newer it will update it.

3) Log file is at /var/log/HPCCSystesm/cluster/XX_install-hpcc_yyyymmdd_HHMMSS.log
    For concurrent exection XX is cc. If run sequentially it is se
HPCC-11155 Allow hpcc-push.sh run concurrently

1) Generate script hpcc-push_ which take only 1 input parameter: ip
2) If python 2.6+ installed it will Run above script through cluster_script.py.
   It allows mulitple instances run simultanously. The default is 5.
   If no python 2.6+ found it will run the script sequentially
3) Log file is at /var/log/HPCCSystesm/cluster/XX_hpcc-push__yyyymmdd_HHMMSS.log.
   For concurrent exection "XX" is "cc". If run sequentially it is "se".
HPCC-11691 Roxie can core on control:unlockdali

If there is a wu queue active, Roxie may core on a control:unlockDali call, as
the queue is cleared asynchronously.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #6010 from JamesDeFabia/HPCC-11611_TyposinEcl_CLIDoc

HPCC-11611 Fix typos in ecl CLI docs

Reviewed-By: Anthony Fishbeck <anthony.fishbeck@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
HPCC-11496 - 2nd attempt at avoiding contention on ClusterLock

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11648 ecl-test.json server section being ignored

Reorganise ecl-test.json to store individual IP address for each cluster

Fix cluster IP handling problem.

Change queryWuid() and abortWorkunit() functions to use extended ECl tool.

Implement local IP query function.

Add Regression Test Engine IP address to OriginalTextFilesIp stored variable
for Setup. (Without this the remotely executed setupsearchindex.ecl doesn't
find the external data file)

Update README.rst

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-11692 Spurious "unregistered query" errors

The queryHash is now derived from (among other things) the timestamps of the
files used by the query. Unfortunately the calculation of the hash included
the uninitialized filler byte in the CDateTiem structure.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #6060 from jakesmith/hpcc-11687

HPCC-11687 Fire exception on connect if from stale client

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #6061 from jakesmith/hpcc-11679

HPCC-11679 Catch exception in connection destructors

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #5993 from afishbeck/wseclTimeouts

HPCC-11590 Add configurable timeouts to WsEcl

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #6017 from afishbeck/hugeArchiveOldBuildErrorMsg

HPCC-11475 Improve error message deploying large archives to old ESP

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>