packages, fhs: fix saxon includes/excludes expression

The current includes/excludes expression in the fhs package assembly xml fails to move the saxon jars with groupId net.sf.saxon or with artifact "saxon-dom" into the saxon subdirectory.

Added the appropriate globbing to fix this.

Target: master
Request: 2.8
Request: 2.7
Request: 2.6
Patch: http://rb.dcache.org/r/6566/
Require-book: no
Require-notes: no
Acked-by: Gerd
Revert "packages, fhs: fix saxon includes/excludes expression"

This reverts commit 9ddc482591a557ef2b363b9c6738dd2007879ff6.

Taking the saxon jars off of the classpath stops the privilege-xacml
client from finding a class.
dcache-core, alarms: restore xml connector to initialization properties

A recent refactoring (http://rb.dcache.org/r/6541) of the connector initialization for the alarms appender inadvertently eliminated the url property for the xml datanucleus plugin.

This patch restores it.

(Note: This is my fault, as I acked that patch and should have noticed it).

Target: master
Require-book: no
Require-notes: no
Patch: http://rb.dcache.org/r/6571
Acked-by: Paul
dcache-webadmin, alarms: remove required annotations from datastore setters

For the profile "alarms-off", the placeholder datastore object is constructed without the following properties:

persistenceManagerFactory
alarmsCleanerEnabled
alarmsCleanerSleepInterval
alarmsCleanerSleepIntervalUnit
alarmsCleanerDeleteThreshold
alarmsCleanerDeleteThresholdUnit

However, the setters on these properties have the "@Required" annotation. This causes a fatal exception at startup.

Removing the annotations restores proper initialization.

(Once again I should have caught this regression, introduced in 6541).

Target: master
Require-notes: no
Require-book: no
Patch: http://rb.dcache.org/r/6572
Acked-by: Gerd
xrootd: Add support for kXR_locate, kXR_query and kXR_set

kXR_locate always returns the door or pool itself, no matter whether the file
exists or not. This avoids an extra name space lookup. It is unknown whether
the argument to kXR_locate contains the opaque information, thus whether the
pool can rely on the uuid being present.

kXR_set is only implemented for appid.

kXR_query is implement for kXR_Qconfig and kXR_Qcksum. In pools we again have
the issue that the spec doesn't define whether the path contains the opaque
info.  The patch speculatively looks for the uuid and returns the checksum if
found - otherwise the client is redirected to the door.

The behaviour on kXR_open is altered slightly to return clients with missing
uuid or invalid uuid back to the door rather than return an authorization
error. The client likely just uses an outdated uuid or wants to open a second
file.

Target: trunk
Require-notes: yes
Require-book: yes
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/6565/
gplazma2-xacml: revert version of opensaml

The privilege xacml client is incompatible with the newer opensaml library.
In particular, the client bootstrap method calls a method which is missing
in the newer version.

Restores opensaml to 2.4.1 (last compatible).  Also eliminates unused opensaml1 library.

Target: master
Request: 2.8
Patch: http://rb.dcache.org/r/6581/
Bug: http://rt.dcache.org/Ticket/Display.html?id=8244
Requires-book: no
Requires-notes: no
Acked-by: Paul
Revert "Revert "packages, fhs: fix saxon includes/excludes expression""

This reverts commit 358648b0c13fe7e553de43125f7c355938e67732.

The saxon changes were unrelated to the xacml/opensaml problem
gplazma-xacml: remove dependency on org.apache.xalan

There is a xalan implementation which ships with Java.  This dependency does not seem necessary.

We now have all saxon jars in a saxon subdirectory, and no other XSLT libraries on the classpath.

Side benefit is that we can use datanucleus-xml 3.2.1 (without the fix I provided) if needed.

Target: master
Request: 2.8
Request: 2.7
Request: 2.6
Patch: http://rb.dcache.org/r/6582/
Require-book: no
Require-notes: no
Acked-by: Tigran
Log fatal errors when fetching pool monitor

Target: trunk
Require-notes: no
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/6586/
nfs-proxy: add support for open-less read requests

in a production we observe situations, where client
decides to perform IO through MDS (door) with
all-zero stateid. Such behavior is  allowed by
rfc5661 (#8.2.3) and should be supported
to keep clients happy.

Acked-by: Gerd Behrmann
Target: master, 2.8, 2.7
Require-book: no
Require-notes: no
Revert "nfs-proxy: add support for open-less read requests"

This reverts commit 20d0df608cfc2b236e3b054cfc2fcb4de5b51278.
nfs-proxy: add support for open-less read requests

in a production we observe situations, where client
decides to perform IO through MDS (door) with
all-zero stateid. Such behavior is  allowed by
rfc5661 (#8.2.3) and should be supported
to keep clients happy.

Acked-by: Gerd Behrmann
Target: master, 2.8, 2.7
Require-book: no
Require-notes: no
ftp: Auto indent data channel code

Indentation contained tab characters and was unreadable.

Target: trunk
Require-notes: no
Require-book: no
Patch: none
pool: Increase TCP backlog for FTP mover

globus-url-copy doesn't appear to handle data channel
TCP rejects well. To reduce the risk we increase the
backlog to 128 (JDK default is 50).

Target: trunk
Require-notes: yes
Require-book: no
Acked-by: Tigran Mkrtchyan <tigran.mkrtchyan@desy.de>
Patch: http://rb.dcache.org/r/6588/
system-test: Add support for compatibility testing releases

Adds support for installing older releases into the system-test build and
allows these to be tested for compatibility with the current build.

The packages/system-test/target/bin/ctlcluster utility operates on the entire
'cluster' of dCache versions, covering both the current build and other
releases that have been installed. Another release is installed using the
'install' subcommand, eg 'ctlcluster install 2.7.5'.  The switch subcommand is
used to move service definitions between versions, eg 'ctlcluster switch admin
2.7.5' moves the admin service to version 2.7.5 and 'ctlcuster switch admin'
moves it back to the current build. Both the service name and a unique property
assignment for the service can be used as identification, eg 'ctlcluster switch
pool.name=pool_write 2.7.5'.

Other releases installed through the 'ctlcluster install' command are
configured to point to the same databases, some of the same configuration (like
certificate stores) and the same plugins (in particular the hsqldb plugin). The
script cannot compensate for differences in property names or schema changes.
This is unlikely to be a problem when testing other releases of the same major
branch, but may be an issue when testing against older feature releases. In
that case the configuration has to be adjusted by hand.

Several other commands that releate to the system-test package have been moved
out of target/dcache/bin and into target/bin: hsqldb, populate, test,
hostCredentials.

The default system-test.conf layout has been adjusted to make the service
definitions easier to move between releases.

The Maven build has been configured to stop the entire dCache cluster before
cleaning the target directory. This is to avoid orphaned dCache instances.

Target: trunk
Require-notes: no
Require-book: no
Acked-by: Tigran Mkrtchyan <tigran.mkrtchyan@desy.de>
Patch: http://rb.dcache.org/r/6585/
nfs-proxy: fix logging

Acked-by: Gerd Behrmann
Target: master, 2.8, 2.7
Require-book: no
Require-notes: no
nfs-proxy: use sessionId provided by Transfer class

Acked-by: Gerd Behrmann
Target: master
Require-book: no
Require-notes: no
nfs4: clean failed request from pending queue

if door have failed to start a mover, then we have to
clean pending message queue to avoid dead records. A
new entry will be created on client retry.

Acked-by: Gerd Behrmann
Target: master, 2.7, 2.8
Require-book: no
Require-notes: no
nfs-proxy: fix logging CDC

Acked-by: Gerd Behrmann
Target: master, 2.8, 2.7
Require-book: no
Require-notes: no
nfs4: remove dead class

obsolete with new NFS code

Acked-by: Paul Millar
Target: master
Require-book: no
Require-notes: no