spacemanager: Use JdbcTemplate and annotation based transaction demarcation

JdbcTemplate is similar to our custom DBManager class. JdbcTemplate is however
much more feature complete. It is also much more well known. This patch replaces
DBManager with JdbcTemplate in space manager.

The patch also changes space manager to Spring's annotation based transaction
demarcation. This removes the need to pass around a Connection object between
methods. It makes it easier to ensure that all processing done for a message is
in a single transaction.

Note that I in some cases have annotated methods with @Transactional even
though they are already called from a transactional context. By default Spring
will simply let the method be part of the outer transaction. I use this for
methods that would not be correct if run outside a transactional context (eg
methods that do select for update).

The patch changes the space manager schema such that primary keys are flagged
as auto increment fields. Thus we no longer need to maintain the counter logic
ourself (the counter logic is tricky in the pressence of transactions as it
must not be rolled back in case of an aborted transaction). How this is
implemented is however database specific and the changeset thus contains some
special cases for PostgreSQL. The liquibase changelog defines rollback logic.
Upon downgrading dCache, the schema changes must be rolled back.

The patch adds unique constraint to pnfsid field of srmspacefile table. An
index on this field already existed, so making it unique does not add any extra
overhead. The column type is changed to varchar(36) to match the type used in
the rest of dCache.

Since JdbcTemplate translates all SQLException instances to a more detailed
exception hierarchy, the patch also updates lots of exception handlers to
catch the more detailed exceptions.

Target: trunk
Require-notes: yes
Require-book: no
Acked-by: Tigran Mkrtchyan <tigran.mkrtchyan@desy.de>
Patch: http://rb.dcache.org/r/6395/
spacemanager: Convert tabs to spaces.

Require-notes: no
Require-book: no
Patch: none
spacemanager: Split space manager into service layer and data access layer

Introduces a clean data access object interface, separating the space manager
into a data access layer and a service layer.

Since all JDBC related code is now in a single class, I have chosen to inline
SQL expressions. I feel this makes the code easier to read as one does not
need to lookup the expressions all the time.

Given the size of the change, it is difficult not to sneak in some minor
janitorial changes in that is touched anyway.

Target: trunk
Require-notes: no
Require-book: no
Acked-by: Dmitry Litvintsev <litvinse@fnal.gov>
Patch: http://rb.dcache.org/r/6396/
transfermanagers: Send subject and updated file attributes to pool

In contrast to other doors, transfermanager does not inject the subject
and updated file attributes intp the pool io file message it sends to pool.
Space manager in master requires this information and thus cannot work
with transfermanagers unless the correct information is injected.

Target: trunk
Require-book: no
Require-notes: no
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/6413/
poolmanager: Remove link group attributes

Link group attributes were not used. The following commands have
been removed from the command line interface:

psu remove linkGroup attribute
psu set linkGroup attribute

The latter of these still exists in the code as a noop to alove existing
poolmanager.conf files to be read.

Target: trunk
Require-notes: yes
Require-book: yes
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/6418/
Reduce class path length on liquibase invocation

Reduces system-test build time by approx. 25 seconds on my laptop.

Target: trunk
Require-notes: no
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/6421/
build: fix RPM builds

The rpmbuild tool requires certain directories to exist and will fail
rather than attempting to create them.  The 'clean' phase of maven will
remove these directories.

This patch adds support to ensure the directories exist.

NB. This patch changes the location of rpmbuild-related directories
from path/to/target/ (e.g. packages/fhs/target/RPMS) to
path/to/target/rpmbuild (e.g. packages/fhs/target/rpmbuild/RPMS).
There is an obvious knock-on effect to the location of resulting RPM
files.

Target: master
Request: 2.7 (as needed)
Request: 2.6 (as needed)
Request: 2.2 (as needed)
Patch: http://rb.dcache.org/r/6427/
Acked-by: Gerd Behrmann
cns: make unit tests less sensitive to speed of computer

A recent build failed because the CNS unit-tests rely on a test taking
no longer than 100 ms to complete.  Under normal circumstances, this
is reasonable; however, the build machine was suffering high IO load
and didn't managed to complete the unit test in the allotted time
window.

While the build machine shouldn't be suffering from this IO-load,
equally, our unit-tests shouldn't fail on slow machines.

This patch doesn't fix the dependency on system time; rather, it
increases the time window to 1 minute.

Target: master
Requires-notes: no
Requires-book: no
Patch: http://rb.dcache.org/r/6432/
Acked-by: Gerd Behrmann
dcache-chimera: Add interactive chimera shell

Adds an interactive shell for chimera. May also be used in non-interactive mode
with a command provided on the command line. In the latter form it supplants
the older chimera-cli utility.

Note that in some cases the argument order has changed compared to the
chimera-cli utility. The argument order now matches the order found in common
Posix utilities.

The chimera-cli utility should be documented as deprecated and eventually
removed from dCache.

The system-test populate script has been updated to use the new utility, which
avoids means the chimera skeleton can be created with a single invocation,
cutting down on the build time.

Target: trunk
Require-book: yes
Require-notes yes
Acked-by: Paul Millar <paul.millar@desy.de>
Acked-by: Tigran Mkrtchyan <tigran.mkrtchyan@desy.de>
Patch: http://rb.dcache.org/r/6423/