Fix gh-2340 - spot invalid files-in-progress file

Detect and rename fip file and refresh

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Split off 3.8.0

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Extend implicit row projection to nested rows

The previous version of the implicit project code only analysed the top
level of fields within a dataset.  If a dataset contained a nested
row field then it was either all included, or all removed.  This
commit extends the functionality so it also removes fields from nested
records if they are unsued.

The main differences are
* Ensuring each set of fields knows the original record structure
* Keeping track of nested fields
* Replacing selectors now also ensures that fields of type datarow are
  mapped if they have been changed.

The advantage is often smaller generated code, and reduced data pulled
from datafiles and indexes.  It also improves the accuracy of an
upcoming feature for describing what data is actually used by a query.

The disadvantage is that this generates more unique row formats - which
increases the size of the metadata classes.  An issue is open to work
on reducing the size of those for the common cases.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Minor clean up of the enumerated type

Add an extra case into the activities enum for rollup and iterate
since it is simpler not to combine them and they have very slightly
different semantics.  (No changes in functionality introduced.)

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Final fixes and minor optimization

The fields used in the rollup condition weren't being included in the
fields required by the output if they weren't qualified with LEFT or
RIGHT.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #2361 from richardkchapman/2281-cherry-pick

2281 cherry pick

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Fix compile problem with CWsDeployFileInfo

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Housekeeping, remove redundant code/files

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
The name EclLimit can be misconstrued therefore the property
more accurately describes its function

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
Merge pull request #2364 from jakesmith/wsdeploy-compilefix

Fix compile problem with CWsDeployFileInfo

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #2367 from jakesmith/redundant-code-removal

Housekeeping, remove redundant code/files

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #2355 from jakesmith/gh-2340

Fix gh-2340 - spot invalid files-in-progress file

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
gh-2363 zip files in local directory cause eclcc to assert

The code that added support for using paths within zip files
and other archives for ecl include can cause an assert error from
eclcc if there are zip files in the current directory (or another
directory mentioned in the path), as it was trying (but failing) to
treat such zip files as directories to be added to the scope as
modules.

Fixes gh-2363.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #2379 from rpastrana/ecljdbc_rename_ecllimit

ECLJDBC Rename EclLimit to EclResultLimit and add range check

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #2374 from richardkchapman/archive-dir-2383

gh-2363 zip files in local directory cause eclcc to assert

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Ensure clearAggregate() fields are assigned in order

For a TABLE() that performs an aggregation (no_newaggregate)
the order of the fields in the transform matches
the order of the fields in the target record.  However, for the new
AGGREGATE operator (no_aggregate) they may not match.  If the record
contains variable length fields, and assignments are done out of order
it can lead to invalid memory accesses.

This change ensures assignments are made in field rather than transform
order.

Fixes #2350.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #2362 from ghalliday/clearaggregate

Ensure clearAggregate() fields are assigned in order

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
gh-2384 Incorrect libarchive dependency in lucid/maverick

The (new) dependency on libarchive was not correct for Ubuntu 10.04
and 11.04 (where the package is called libarchive1).

Fixes gh-2384.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #2385 from richardkchapman/archive-dependency-2216

gh-2384 Incorrect libarchive dependency in lucid/maverick

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
Fix various problems with the checking allocator

Added some unit tests for the row allocator

- The checking allocator wasn't being matched correctly

- A few places were not correctly adjusing for the extra checking bytes

Fixes #2359 reported by Jake.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>