Merge pull request #4206 from dballesteros7/create-error-report-on-createfailed

Create error report for createFailed jobs
Merge pull request #4203 from ticoann/t0wmstats_deploy

add t0wmstats dependency
Merge pull request #4196 from PerilousApricot/bugfix/detonating-logs

Fixing giant log files/memory leaks
0.9.26

Signed-off-by: Stephen Foulkes <sfoulkes@fnal.gov>
fix the typo in the jobstatus
Implement checksums in LCGImpl backend module

Add support for verifying the adler32 checksum when available
through the lcg-ls -l command. Also add general support
for passing the locally calculated checksums of the files
to the StageOutImpl objects, this will enable the checksum
verification in the rfcp-CERN backend plugin as well.

For the LCGImpl plugin the checksum is obtained as follows:

echo "$LCG_OUTPUT" | sed -nr 's/^.*\s([a-f0-9]{8})\s*\([aA][dD][lL][eE][rR]32\)\s*$/\\1/p'

Where LCG_OUTPUT=`lcg-ls -l -b -D srmv2 <SURL> 2>/dev/null`

The expected format of LCG_OUTPUT is a multi-line string where one of the lines has the following format:

* Checksum: <8-hex character string> (ADLER32)

Or

* Checksum: <8-hex character string> (adler32)

If this line is not present then it is assumed that the checksum is not supported and the check is skipped,
but if a checksum is present then it will be compared and will fail with exit code 63011 if it doesn't match.
Error code is the same as for size mismatch.

Fixes #4185
Ops ReqMgr interaction script, ProcConfigCacheID renaming
Merge pull request #4223 from zdenekmaxa/reqmgr-ops-scrips-01

Ops ReqMgr interaction script, ProcConfigCacheID renaming
Bugfix for PrimaryDataset handling in RelVal

The PrimaryDataset argument wasn't really suited to be included in the
ParameterStorage decorator used to modify global parameters according
to task-level specifications. Since the PrimaryDataset
is not really a global parameter and always a task one, changed this support
for PrimaryDataset in order to make this actually work.

Added unit test verification of the output datasets to catch these errors.

Fixes #4225
Merge pull request #4228 from dballesteros7/fix-taskchain-bug

Bugfix for PrimaryDataset handling in RelVal
Bugfix for wmagent config

The spec cache path was not correctly set by the mod-config
Merge pull request #4194 from PerilousApricot/feature/stageout-switch

Add per-request switch for stageout
Merge pull request #4231 from dballesteros7/fix-wmagent-config-phedex

Bugfix for wmagent config
remove workloadsummary installation from reqmgr and move to reqmon
Revert "Ops ReqMgr interaction script, ProcConfigCacheID renaming"

This reverts commit d01c12d692825c485dab43849765e08e59d237ba.
0.9.27

Signed-off-by: Stephen Foulkes <sfoulkes@fnal.gov>
Revert "Revert "Ops ReqMgr interaction script, ProcConfigCacheID renaming""

This reverts commit 138bf6cf591a23af5cf99ff0d03d0ae1f9fbb0f2.
Remove updates in cancellation - stop conflicts
ReqMgr requests clone implemented.

A few functions / methods signatures changed in the ReqMgr files.
Requests clone implemented: PUT, /reqmgr/reqMgr/clone/requestName, unittest
for clone and reqmgr.py clone interface.
reqmgr.py has --allTests to run over everything the script is capable of for
testing.
Clone request shall fix: #3984, #3944
lexicon add dbs user