Merge pull request #2188 from richardkchapman/precise-workaround-2187

gh-2187 hpcc-init fails to stop thor on Ubuntu 12.04

Reviewed-By: Jake Smith <jake.smith@lexisnexis.com>
Fix gh-#2065 Replace 'SMC' in ECLWatch/ConfigMgr UI

Existing ECLWatch Permission area shows 'SMC' as feature name.
This fix changes it to better names. Most of the changes are
in environment.xml and other deployment scripts which create
the term into esp.xml. It is decided to rename the 'ESP
Services for SMC' to be 'ESP Services for management console'
and rename the 'Root access to SMC service' to be 'Base
access to ESP services'. This fix also changes the term
'espsmc' to 'eclwatch'.

Signed-off-by: Kevin Wang <kevin.wang@lexisnexis.com>
Keep 'SmcAccess' and better display of permissions page

Signed-off-by: Kevin Wang <kevin.wang@lexisnexis.com>
Fix selfjoin global child query stall

A selfjoin within a global child query (loop) was stalling on 2nd iteration
of loop

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
gh-2181 ecl package delete can cause esp to core

Properly delete from PackageMap and PackageSet

Fixes gh-2181

Signed-off-by: Stuart Ort <stuart.ort@lexisnexis.com>
#2242 Removed all "stream" references

The feature is now called hdfs/hpcc connector, and this name is reflected in
all user visible files. Internal build processes also reflect this name shift.

To build this feature, turn this flag on: USE_HDFSCONNECTOR

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
Merge pull request #2249 from rpastrana/replace_streaming_labels

Replace streaming labels

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
#2243 H2H logs to standard hpccsystems log location

The H2H feature now logs to the standard hpccsystems log location.
HPCC environment.conf variables are used to determine appropriate location.
New component "mydataconnector" dir is created and logs written there in
the following format: mydataconnectors/HDFSCONNECTOR.$nodeid.$PID.log.

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
The H2H feature now logs to the standard hpccsystems log location.
HPCC environment.conf variables are used to determine appropriate location.
New component "mydataconnector" dir is created and logs written there in
the following format: mydataconnectors/HDFSCONNECTOR.$nodeid.$PID.log.

Removed ability to overwrite h2h log location, per Phil's comment.

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
Using sizeof(record, max) to determine records' max length, which is used
to determine termination threshold in case of data format error.
This replaces the use of sizeof(record), which didn't allow the use of var
len record definitions.

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
Bug #2229 ECLJDBC driver inherits platform's cmake version variables and values.

Although the ECL JDBC driver is a stand-alone JAVA based application, without
any direct dependency on the platform, it will be versioned in parallel with the
platform. In order to achieve this, a simple java class is generated by the CMAKE
configuration process. This "version tracker" class contains final static values
based on the platform's cmake version variables. The entire project is free to use
those fields for version reporting purposes.

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
Merge pull request #2265 from rpastrana/h2h_allow_varlen_CSV_pipein

H2h allow varlen csv pipein

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge branch 'move_h2h_logs_to_standard_loc' of https://github.com/rpastrana/HPCC-Platform into rpastrana-move_h2h_logs_to_standard_loc

Conflicts:
	plugins/dataconnectors/hdfsconnector/hdfspipe.in

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Fix issues with distributed results in child queries

Rewrite the way intermediate child query/loop query results are handled.
They need to be accessible by other global queries and remain distributed,
but also collated (on demand) by local child queries or context requests

Also fix an abort issue, where query could hang.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Global patch of loop subgraphs
#2229 Restructured path variables to avoid long relative path per code review

Due to the current mechanism for building seperate packages, having a relative
path to the HPCC-Platform source dir is unavoidable. However, I previous 7 dir
relative path was not necessary. HPCC-Platform source dir is set at ECLJDBC
SRC root in order to find version.cmake file.

Signed-off-by: Rodrigo Pastrana <Rodrigo.Pastrana@lexisnexis.com>
Fix loop empty error, if any slaves sill processing

Loop fires an error if the loop is empty repeatedly more than N times.
Unfortunately, it was detecting this independently on any node for a global
query, meaning, if any slave was empty for N times, whilst another was
processing, the error was fired

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
GH#2276 Created guide for HDFS connector

Signed-off-by: JamesDeFabia <James.Defabia@LexisNexis.com>
Typo corrections and minor updates to ECL LRM
Fix join nosort primary regression

A global join, where primary side already sorted, the partitioning code was
using the wrong row interfaces causing a crash.
This slipped by because legacy code also provided the wrong rowIf, but got
away with it because it wasn't transferred in a array swap operation

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>