gh-2237 Order of ecl package command line arguments

Parameters with no leading '-' should not be required to be the
last params in the param list

Fixes gh-2237

Signed-off-by: Stuart Ort <stuart.ort@lexisnexis.com>
Community Edition 3.8.0 Release Candidate 0

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Couple 3.8 specific changes
#2356 Filter out format related chars from dataformat param

Filter out format related characters ( \n\r\t) from dataformat
imput parameter in ECL Macro before forwarding value to H2H
executable.

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
The name EclLimit can be misconstrued therefore the property
more accurately describes its function

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
Unlock access to File monitor singleton

Added corresponding unlock for file monitoring singleton lock. Related to gh-2057 fix (#2170).

Fixes gh-2371

Signed-off-by: Sridhar Meda <sridhar.meda@lexisnexis.com>
Merge pull request #2373 from smeda/issue2371_1

Unlock File/Directory monitoring singleton

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
gh-2363 zip files in local directory cause eclcc to assert

The code that added support for using paths within zip files
and other archives for ecl include can cause an assert error from
eclcc if there are zip files in the current directory (or another
directory mentioned in the path), as it was trying (but failing) to
treat such zip files as directories to be added to the scope as
modules.

Fixes gh-2363.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Optimise NORMALIZE to DATASET

This optimisation regards transforming a number of
normalize(row, count, trans(COUNTER)) constructs into
dataset(count, trans(COUNTER)). Tests added.
Allow dataset to have its arguments optimised
Allow dynamic counts
Adding output to avoid premature optimisation on LEFT case
Add comment on how to debug symbols
Merge pull request #2379 from rpastrana/ecljdbc_rename_ecllimit

ECLJDBC Rename EclLimit to EclResultLimit and add range check

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Remove code that is no longer required

A long time ago these attributes were required on the expressions to
cope with implicit relationships between SQL-like tables.  That code
has now gone, so these attributes can also be removed.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #2374 from richardkchapman/archive-dir-2383

gh-2363 zip files in local directory cause eclcc to assert

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Ensure clearAggregate() fields are assigned in order

For a TABLE() that performs an aggregation (no_newaggregate)
the order of the fields in the transform matches
the order of the fields in the target record.  However, for the new
AGGREGATE operator (no_aggregate) they may not match.  If the record
contains variable length fields, and assignments are done out of order
it can lead to invalid memory accesses.

This change ensures assignments are made in field rather than transform
order.

Fixes #2350.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Clean up code and remove unused function

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #2362 from ghalliday/clearaggregate

Ensure clearAggregate() fields are assigned in order

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Ensure hpcc-init setup has been called

Hpcc runtime directories must exist, the component directories can be
created by the component, but Thor cannot create the parent directories,
e.g. /var/log/HPCCSystems

Slaves used to call hpcc-init -c <thorcomponent> setup in slave scripts, but
cannot anymore, see gh-1609 and gh-1412 for reasons.

Since Dafilesrv must exist on all nodes, perform a dafilesrv setup to
ensures these common directories exist.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>