if parent job don't exist ignore
Allow multiple DQMConfigCacheIDs in TaskChain

Assume that Task3 and Task2 have DQM output,
then the usage is :

{ "DQMConfigCacheID" : .....,

   "Task2" : {"DQMConfigCacheID" : ....}
}

With this configuration Task3 will use the original DQMConfigCacheID
in the main dictionary but Task2 will use the the DQMConfigCacheID
defined in its own internal configuration.

Fixes #4614
Allow overrides on the Primary dataset

Only for MonteCarloFromGEN workflows, when
PrimaryDataset is specified the output will use this instead
of the input primary dataset.

Fixes #4615
Fix bug with updating the logArch location

Sometimes the WMStats document doesn't exist
when trying to associate a logArchive location
this caused the update function to crash. Fix it.
Catch duplicate insertions in DBS

They happen quite often, the reason is understood and it's a problem
in the DBS3 server. Yuyi is aware of it, from the WMAgent side
we will ignore these errors.
Fix location update for Pileup on Generation

When the top level task is a Production task with no DBS Url,
the location updater crashes since there is no DBS to do the
location update. Fix that by including a DBS url in the workqueue
element even if not present in the top level task, it will use one from
the pileup datasets.
Kill child process when shutdown.
Clean up the log
Catch proxy errors

If a 502 Proxy Error happens, it is likely that the block was inserted
but the response was not returned in time and it was killed by the
cmsweb frontend. Check if the block is in DBS3 already and if it is
then declare it successful.
Add /store/mc/* to qualified lfn names. YG
0.9.71

signed off - Seangchan Ryu
Add AMQ_AUTH_FILE.
increase default request timeout to 2 min
Using SiteDB v2 API

Replacing old SiteDB v1 API with v2.
Have to use pycurl, otherwise getting
zlib.error: Error -3 while decompressing data: incorrect header check
when calling SiteDB.
Configuration updated.

Fixes #4625
Merge pull request #4661 from zdenekmaxa/reqmgr-sitedbv2api-4625

Using SiteDB v2 API
0.9.72

Signed-off-by: Zdenek Maxa <zdenek.maxa@cern.ch>
Add support in Reqmgr for deterministic pileup

It just adds a new parameter to the splitting
algorithms in ReDigi. The actual support will come
in a WMAgent patch that is still under testing.
Fix bug in WMBSHelper when no subs are present

If no PhEDEx subscriptions are present, the WMBSHelper
crashes when injecting the subscriptions into WMBS.

Fix this and change the unittest to trigger the error without
the fix.
Replacing old SiteDB v1 API with v2.

Replacing #4661
Uses Services/SiteDB interface
SiteDB URL completely removed from the configuration.

Fixes #4625
Merge pull request #4664 from zdenekmaxa/reqmgr-sitedbv2api-4625-2

Replacing old SiteDB v1 API with v2.