HPCC-10077 - Spray compressed does not set @compressedSize on file parts

Some modification to triage

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-10077 - Spray compressed does not set @compressedSize on file parts

Some modification to triage and check the data flow.

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-9723 change Package name to allow multiple clienttools installed

change ClientTools package name to "hpccsystems-clienttools-<major version>.<mintor version>
This will allow multiple clienttools with different <major version>.<mintor version> installed
on the systems. For example following clienttools can co-exist on a system:
   hpccsystems-clienttools-4.0_community-4.0.2-2el6_x86_64.rpm
   hpccsystems-clienttools-4.2_community-4.2.0-1el6_x86_64.rpm

On the other hand if <major version>.<mintor version> are the same the newer package can be updated
on the top of older package. for example,
1) With different pack number:
   hpccsystems-clienttools-4.2_community-4.2.2-1el6_x86_64.rpm can be updated on top of
   hpccsystems-clienttools-4.2_community-4.2.0-1el6_x86_64.rpm

2) With different build(sequence) number
   hpccsystems-clienttools-4.2_community-4.2.0-2el6_x86_64.rpm can be updated on top of
   hpccsystems-clienttools-4.2_community-4.2.0-1el6_x86_64.rpm
HPCC-9723 Add PACKAGE_FILE_NAME_PREFIX

Add a new varialbe PACKAGE_FILE_NAME_PREFIX in top level CMakeLists.txt which will have pacakge
name without version information. It is used for creating CPACK_PACKAGE_FILE_NAME
HPCC-9847 ECLCC crash due to dynamic record type within a MODULE

The fix here is only temporary, to prevent the crash. Really the grammar/syntax
should be changed to force (possibly implicitly) dynamic record types as VIRTUAL
types when passed as a function argument.

Signed-off-by: jamienoss <james.noss@lexisnexis.com>
HPCC-10077 - Spray compressed does not set @compressedSize on file parts

Extend ICompressedFileIO to provide compressed size value.

Add code to FtClient to send back compressed part size after it created
and renamed.

Add code to store compressed part size into partition metadata.

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-10022 Ensure duplicate persists within a query are still caught

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-10077 Spray compressed does not set @compressedSize on file parts

First update after review.

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-10149 Optimize JOIN(l,r,...,t(LEFT),ATMOST(1),LEFT OUTER)

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-10149 More tests, and don't optimize KEEP(1),LIMIT(n)

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-10160 EclAgent core if PERSIST names invalid thor cluster

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-10161 Add option in eclagent to force persist rebuilds, for debugging

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-10077 Spray compressed does not set @compressedSize on file parts

Second update after review.

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-10077 Spray compressed does not set @compressedSize on file parts

Remove unnecessary changes.

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-10108 No way to disable quote processing and use the CSV quick partitioning

Add quote char overriding with zero ('') string capability.
Fix empty quote handling bug in CCsvQuickPartitioner constructor.
Add extra pass to discover record structure into CCsvQuickPartitioner.

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-8902 #workunit ('cluster', 'xxx') not supported by eclccserver

Make sure that the cluster info is cloned from the generated workunit.

Add code to eclccserver to reload the cluster after compilation, and
check it is valid.

Add code to ecl run to reload the cluster after compilation.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-10149 Fix regression test, and check for KEEP(1), LIMIT(n)

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
HPCC-10108 No way to disable quote processing and use the CSV quick
partitioning

Remove changes from CCsvPartitioner constructor.

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-9982 Jobs run on hthor should fail if they need to rebuild a thor persist

Changing clusters in thor jobs doesn;t work, so a persist that names the
cluster it wants to run on will try to rebuild on hthor if a job that uses it
is accidentally run on hthor (or deliberately run on hthor in the hope that
the persist did not need to be rebuilt.

This change only protects cases where a specific cluster has been specified
for a persist. A future commit will look at adding a 'platform type' attribute
on a persist.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #4928 from richardkchapman/persist-cluster-core

HPCC-10160 EclAgent core if PERSIST names invalid thor cluster

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>