HPCC-9935 Add SourceFormat to ESP FileSpray/SprayFixed request

In new ECLWatch UI, the SprayFixed Input page may add a Source
Format selection which contains: fixed, recfmv, recfmvb, and
variable. The FileSpray/SprayFixed should read the selection and
forward the selection to DFU workunit.

Signed-off-by: Kevin Wang <kevin.wang@lexisnexis.com>
HPCC-9249 Return user/IP for paused queue to WsSMC/Activity response

This fix allows a user add some comment when the user
pauses/stops/resumes a queue through WsSMC service. The comment, as
well as user name, IP, and time, will be stored and returned as a
part of WsSMC/Activity response.

Signed-off-by: Kevin Wang <kevin.wang@lexisnexis.com>
HPCC-9481 CSV record definition auto discovery

Part I.

Add
- implementation for CSV record structure discover
- new parameter to signal CSV file contains field definition in first row
- new parameter handling to WU enviromnet
- new parameter handling to DFUPlus

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-9984 Compile direct from a version control system

Add code to eclccserver to support installation of hooks in place of eclcc,
and to pass values to those hooks via the environment.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9984 Compile direct from a version control system

Add support for bare repositories into the git file reader.

Note that this change means that the {branch} part of the git file
name is no longer optional. To refer to HEAD (on a non-bare repository)
you can use {}

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9481 CSV record definition auto discovery

Part I.

Add
- implementation for CSV record structure discover
- new parameter to signal CSV file contains field definition in first row
- new parameter handling to WU enviromnet
- new parameter handling to DFUPlus

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-9984 Compile direct from a version control system

First stab at a vc hook for git repository support

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9984 Compile direct from a version control system

Don't allow workunit to set the hook - would be some security concerns.

Define an environment variable for the current thread index, in case anyone
wants it for an svn plugin.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9984 Compile direct from a version control system

Control whether local WU can override the branch

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9984 Compile direct from a version control system

Typo in git.sh meant only worked in verbose mode.

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge branch 'HPCC-9481-feature' of github.com:AttilaVamos/HPCC-Platform into HPCC-9481-feature

Conflicts:
	dali/ft/daftformat.cpp
	dali/ft/daftformat.ipp
	dali/ft/filecopy.cpp

Signed-off-by: Attila Vamos <attila.vamos@gmail.com>
HPCC-9974 Add self-test option to ecl-bundle

New ecl-bundle selftest subcommand

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
HPCC-9460 First Name and Last Name missing from My Account user area

When authenticating the sysuser, the password is verified based on the
value in the config file and not whats stored in LDAP. The early return
from this check means we did not go to LDAP to query the sys user's other
properties such as first/last name. This code change allows the code to
proceed until we get these properties and the returns them

Signed-off-by: William Whitehead <william.whitehead@lexisnexis.com>
Merge pull request #4849 from RussWhitehead/ldapUsername

HPCC-9460 First Name and Last Name missing from My Account user area

Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
HPCC-10043 Add option to eclcc to restrict compilation to repository

Set --deny=userECL in the eclccserver options to require that all jobs use
only code that is already present on the eclccserver (typically, from an
external repository via eclcc-hook)

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #4845 from richardkchapman/ecl-bundle-tests

HPCC-9974 Add self-test option to ecl-bundle

Reviewed-by: Gavin Halliday <ghalliday@hpccsystems.com>
HPCC-9935 Add version number to new request item

Increase the version number of ESP/FileSpray service and add the version
number to new request item.
HPCC-10060: Improve memory and thread handling of embedded Java code

Within destructor for JavaThreadContext class, add an explicit DetachCurrentThread() call to detatch the native thred from the JVM.  This allows the JVM to more easily determine what needs to be garbaged collected.

Within the constructor and destructor for JavaEmbedImportContext class, add calls to push and pop a local reference frame in the JNI.  This collects new local references and enables them to be GC'd when the frame is popped, freeing memory somewhat faster.  Also, allow up to 64 local references to be tracked/created (up from the default of 16).
HPCC-10044 Add IsLibrary, PublishBy, etc to WUQuerysetDetails/WUQueryDetails

Add IsLibrary and PublishBy for WUQuerysetDetailsResponse; Add IsLibrary,
Priority, WUSnapShot, LibrariesUsed, Errors, GraphIds and CountGraphs to
WUQueryDetailsResponse.

Signed-off-by: Kevin Wang kevin.wang@lexisnexis.com
HPCC-10044 Rename a method based on code review