Clarify issues in code from review comments.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Report a warning when substring applied to a numeric

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Allow makeAbsolutePath on non-existent paths

Prior to gh-1605, win/lin would return a absolute path for non-existent file
paths.
In Linux, this was despite realpath returning an error
i.e. the result was still expanded to some extent, in most cases obscuring
the error.

The introduction of the throw if !realpath, broke a few components,
where paths that did not [yet] exist were passed.
[The main cases I saw were via openLogFile], but there were others.

This change allows either it to insist on the path being resolvable, or
attemps to resolve as much as possible, i.e. expand links etc. The latter
being the default.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
added info that component names in ConfigMgr are restricted to AlphaNumeric chars or underscore

Signed-off-by: unknown <defabijx@BCTDW7DEFABIJX.risk.regn.net>
Remove ThorCluster prop @slaves

Already absent from the xslt/xsd's, but still part of the environment xml
and generated by the wizard.
Remove from environment and calculate based on ThorSlaveProcess and
slavesPerNode.
Which avoids having to maintain (and potentially get wrong) number of slaves
in environment.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
A couple of minor changes after comments

Remove redundent path null terminators
Use max_path in windows

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
gh-1332 - Reduce dafilesrv inactive client logging

A connected inactive client (>12mins), was being checked every minute
to see if was still alive and if it was "Inactice client" messages for all
files from the client were being logged.
This can be excessive in some situations.

Still want to check per minute, but add extra timeout to control frequency
of warning

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Implement a SHUFFLE activity and keyword

- New SHUFFLE keyword (provisional)
  SHUFFLE(ds, { grouping }, { sort }, options);
  Equivalent to
  UNGROUP(SORT(GROUP(ds, grouping, options), sort));

- Add options to
  * Translate SHUFFLE operations to equivalent if engines don't support it
  * Create SHUFFLE for the inputs to thor local joins if possible.
  * Use SHUFFLE instead of a SORT if that is possible.
  * Use shuffle to reorder join conditions if one side is already sorted

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #1758 from ghalliday/substringwarn

Report a warning when substring applied to a numeric

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Clean up code based on code review comments

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Fix ecl command line not showing server side compilation errors

Fixes https://github.com/hpcc-systems/LN/issues/417

Signed-off-by: Anthony Fishbeck <Anthony.Fishbeck@lexisnexis.com>
Merge pull request #1761 from afishbeck/show_deploy_errors

Fix ecl command line not showing server side compilation errors

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
FIX: add new jfile "queryTempfilePath" function

Adding common function to be used to query the location for temp files

Signed-off-by: William Whitehead <william.whitehead@lexisnexis.com>
Merge pull request #1751 from JamesDeFabia/ChangeLenny2Squeeze

Install docs now refer to Debian 6 Squeeze instead of Debian 5 Lenny

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #1755 from jakesmith/makeabs

Allow makeAbsolutePath on non-existent paths

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Reviewed-By: Renato Golin <rengolin@hpccsystems.com>
Merge pull request #1757 from jakesmith/gh-1332

gh-1332 - Reduce dafilesrv inactive client logging

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #1640 from wangkx/gh1631

Better alignment for Name column in Browse Files by Scope

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Add support for local files in Roxie

Code stolen from EclAgent, makes sure Dali files can be
handled localy, if no Dali server is connected.
Simplify local resolution code
Merge pull request #1705 from ghalliday/stepjoinassert

Fix problems with global priority stepped join.

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Reviewed-By: Renato Golin <rengolin@hpccsystems.com>