HPCC-12592 DOCS:Update Samples in installing and Running

FIX HPCC-12592 DOCS:Update Sample cmds installing and Running
Update documentation sample commands removd the -u hpcc
as that is no longer necessary.

Signed-off-by: g-pan <greg.panagiotatos@lexisnexis.com>
HPCC-10359 Embedded Python may fail due to ^M characters in source

This was fixed in 4.2.0 but the fix was lost in 5.0.2 and 5.0.4.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #6656 from richardkchapman/python-embedded-cr

HPCC-10359 Embedded Python may fail due to ^M characters in source

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
HPCC-12468 Belongs to superfile tab added

Add a tab that displays any superfiles that the subfile may belong to.
There can be multiple superfiles that a subfile can belong to so adding a tab
to show multiples if needed.

Signed-off by: Miguel Vazquez <miguel.vazquez@lexisnexis.com>
Merge pull request #6642 from miguelvazq/HPCC-12468

HPCC-12468 Belongs to superfile tab added

Reviewed-By: Gordon Smith <gordon.smith@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
HPCC-11371 Docs: Fix DICTIONARY Example

Signed-off-by: Jim DeFabia <jamesdefabia@lexisnexis.com>
HPCC-12594 Allow DATASET(value) in a record to add a dataset field

By default using a dataset in a record implicitly expands all the fields out

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #6665 from JamesDeFabia/11371FixDocsDICTIONARYExample

HPCC-11371 Docs: Fix DICTIONARY Example

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Merge pull request #6672 from ghalliday/issue12594

HPCC-12594 Allow DATASET(value) in a record to add a dataset field

Reviewed-By: Jamie Noss <james.noss@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
HPCC-12115 Eclserver should use same hooks as eclccserver

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #6681 from richardkchapman/eclserver-githooks

HPCC-12115 Eclserver should use same hooks as eclccserver

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Merge pull request #6649 from g-pan/H12592-SampleInR

HPCC-12592 DOCS:Update Samples in installing and Running

Reviewed-By: Jim DeFabia <james.defabia@lexisnexis.com>
Reviewed-By: Xiaoming Wang <xiaoming.wang@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
HPCC-12602 Update ESDL executable

-Add unbind service method
-Add delete definition method
-Add List def and binding methods

Signed-off-by: rpastrana <rodrigo.pastrana@lexisnexis.com>
HPCC-12642 Add link implementations that are not thread safe

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-12645 Don't generate internal errors looking at old workunits

The "kb" stats kind was only used in 5.0.4 to record the peak memory used
by a workunit.  This allows those workunits to be read, but sizes will be
out by a factor of 1000.  Not worth providing full support since it
hasn't been used for anything afaik.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-12644 Fix problems in 32bit folding int64 return types

intresult was signed, causing the '+' to decrement the value, resulting
in a value 2^32 smaller than it should have been.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-11928 Smart Join failing over to full join too early.

When smart join ran out of memory, it attempted to 1st failover
to a local lookup join, however, in doing so it consumed too
much memory too early, causing the local lookup to failover to
a standard join too early.
The reasons it used too much memory too early were:

1) A distributor on the LHS was started asynchronously, meaning
the receiver side started buffering up rows contributing to an
overall shortage of memory.

2) The local row tables from each node that are built up as
part of the 1st phase (std. lookup) are cleared of non-local rows
by the first OOM (failover to local lookup), these partial row
arrays can be quite big and sparse and had were not spillable.
a) Transfer the biggest chunk into the loader for the rest, to
allow as much as possible to free up from these row arrays
b) TBD: realloc the sprase array ptr to smaller required size
(See HPCC-12511)
c) Make them spillable at a lower priority than gathering to
local join stage. If the gather OOM's then we have to failover
to std. join, spilling the row arrays may free up enough memory
for local lookup to fit.

3) When the broadcast detects an OOM and clears non-locals, it
must still deal with rows in transit, these can cause another OOM
particularly if they involve a ptr array expansion. Handle by
spilling to a separate single overflow (there won't be that many)

4) Needed a separate final broadcast to check if anyone had
failed over from local lookup to full lookup

5) When failing over to local lookup, transfer the largest slave
array into the loader, to free up it's memory (ptr table) asap

6) Ensure ptr table arrays are destroyed by stream spillers asap,
i.e. when all rows consumed, or spilt and remove MM buffer
callbacks asap also, to avoid pointless callbacks to something
that can no longer spill

7) Rename a few test member variables for clarity,
e.g. isLocalLookup()

8) Add some more comments to explain tactics

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11928 Fix a couple of issues picked up in review

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11928 rhsAlreadyChanges

1) Take account of local and global already sorted meta data
2)Spotted that marker may have been sorting when didn't need to
3) Avoided rhs rows moving in and out of collector if already
collated.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Merge pull request #6710 from jakesmith/hpcc-11928

HPCC-11928 Smart Join failing over to full join too early.

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>