ISSUE:1190 envgen error checking for integer params

Add integer validation for command line
parameters.

Add meaningful error messages when integer
validation fails.

Signed-off-by: Gleb Aronsky <gleb.aronsky@lexisnexis.com>
cannotRemove refactoring

Renamed cannotModify to canModify, same with remove,
and moving the logic inside the file, since it didn't
belong to directories anyway. Instead of using flags,
now using what the methods mean and one call the other
when need.

There is a kludge in Dir::cannotRemove() that will be
cleaned in a subsequent patch, as soon as doRemoveEntry
gets a file as argument, not a filename.

If I manage to finish this second step before this pull
request is pulled, I'll merge them two.
Add superfile name to error
This commit only reformats the code.

Signed-off-by: Kevin Wang <kevin.wang@lexisnexis.com>
gh-1776 EclWatch pauses/clears queues for Roxie/HThor

A drop down menu is added for Roxie/HThor cluster to
pauses/clears queues. I also improved the index.xslt:
better confirmation messages; removed old code lines
which are no longer used; changed some function names
and variable names for better read.

Signed-off-by: Kevin Wang <kevin.wang@lexisnexis.com>
Revised based on review

Signed-off-by: Kevin Wang <kevin.wang@lexisnexis.com>
LDAP check for non-expiring passwords

Even when the domain policy specifies that account passwords expire after
a certain time period, individual accounts can still be specified as never
expiring (admin accounts, for instance).  Add an addition test for this
case when a user logs in.

Signed-off-by: William Whitehead <william.whitehead@lexisnexis.com>
Ensure subgraphs of a global loop are global

If the loop is global and executing subgraphs synchronously, then ensure all
subgraphs of the loop are marked global. Otherwise, the locally executed
subgraphs, will call back to the master and can cause race conditions, when
creating the graph on the master.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Guard against potential race condition

For child graphs, that are initiating creation on master, there's a possible
race condition if multiple slaves initialize the graph and/or request graph
initialization data at the same time

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Ensure jobtemp spill files are replicated

There can be a large period of time between thor executing different
graphs in a workunit, e.g., if other high priority jobs take precedence.
This means it is more likely that a machine may have been swapped in
the meantime.  Therefore any file which has lifetime beyond a single
graph should be replicated - otherwise the entire job may need to be
rerun.

Fixes #1944.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #2118 from ghalliday/issue1944

Ensure jobtemp spill files are replicated

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Fix limitations with meta information for FAIL

IF(cond, dataset, FAIL) should inherit the meta information from the
left dataset.  This fix adds an "ANY" sort order/distribution which
allows the meta information to be calculated correctly.

It is possible this could also be used for some other node types (e.g.,
anything that has a single row).

Fixes Bugzilla bug #100253

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Stop LIMIT SKIP|ONFAIL attributes being ignored

On very rare occasions the SKIP/ONFAIL attribute of a limit could
be ignored.  It occurred when a limit was incorrectly evaluated
using inline code, rather than executed in a child query.  This fix
ensures it is executed in the correct place.

Example was SET(LIMIT(ds, ONFAIL), field).

There were no other examples in any archived queries.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Merge pull request #2108 from ghalliday/failmeta

Fix limitations with meta information for FAIL

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Add ConfigMgr support for ws_ecl VIPS

Added ability to configure VIPS in ws_ecl esp service via ConfigMgr.
Updated XSD files to read in the new fields. Updated the XSL files to generate the VIPS into the esp configuration.
Also, updated the handling of the xpathType attribute to allow resolution against multiple values.
This was needed to handle the requirement that each Roxie only appear in atmost one VIP.

Fixes gh-2077

Signed-off-by: Sridhar Meda <sridhar.meda@lexisnexis.com>
A couple of mptags not deallocated by acts

Global sort and join, allocated an mptag but neglected to deallocate.
This was noticed, after Thor had been running for a good while and the leaks
had built up, eventually triggering a 'Out of message tags' error.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Potential failure in overflow buffer code

Some thread unsafeness in the overflow buffering code, could lead multiple
readers to cause the readersInUse count to go astray, and result in a
spurious assert later and/or other potential issues

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Merge pull request #2102 from smeda/issue2077

gh-2077 Add support in ConfigMgr for configuring VIPS in ws_ecl esp service

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Delay reading files in the include directories

Improves the startup time for eclcc in non-legacy mode.
The call to contents->length() had the side-effect of loading the file
into memory (since it may need to convert formats etc.).  This fix
delays the call to length() until it is needed.

Signed-off-by: Gavin Halliday <gavin.halliday@lexisnexis.com>
Splitter in child query race

Small window, where a downstream window might ask for meta info from
splitter output, before inputs have been reinitialized in reruns of a child
query.
Clear out old splitter input instances at end of query execute.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>