httpd: Fix a couple of bugs

Target: trunk
Require-notes: no
Require-book: no
Request: 2.9
Request: 2.8
Request: 2.7
Request: 2.6
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/7002/
pool: Improve robustness of p2p

In pool to pool transfers, the receiving end periodically pings
the sending end to verify that the transfer is still queued. If
the ping fails, the p2p is aborted.

This patch changes the behaviour when the ping times out: A timeout
usually means that the cell connection got lost or some services
are overloaded. In the first case, a new ping should eventually
result in a no-route-to-cell error, or a negative reply from the
source pool if it was restarted. In the second case, aborting the
p2p just leads to it being retried at a higher level, causing a new
p2p to be enqueued, a new source mover to be started, etc, thus
ultimately creating more load.

In either scenario, it is preferrable to retry the ping rather than
aborting the pool to pool transfer.

The patch also addresses the case in which the HTTP URL from the source
mover arrives after the receiving end gave up: In that case we now
try to locate another pool to pool transfer for the same file.

Target: trunk
Require-notes: yes
Require-book: no
Acked-by: Albert Rossi <arossi@fnal.gov>
Patch: http://rb.dcache.org/r/6996/
cleaner: Shut down timer thread

Target: trunk
Request: 2.9
Require-notes: yes
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/7003/
ftp: Add more information to info page

A recent change in the FTP door removed some logging from the pinboard. Some
information that could previously be glanced from the pinboard is now
inaccessible.

This patch adds a bit more information to the info output.

Target: trunk
Require-notes: yes
Require-book: no
Acked-by: Albert Rossi <arossi@fnal.gov>
Patch: http://rb.dcache.org/r/7004/
ftp,dcap: Don't export child doors

This patch fixes a regression introduced in dCache 2.7.

Target: trunk
Request: 2.9
Request: 2.8
Request: 2.7
Require-notes: yes
Require-book: no
Acked-by: Albert Rossi <arossi@fnal.gov>
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/7005/
srm: Fix NPE

Restored requests don't have an origin principal and cause an NPE.

Target: trunk
Request: 2.9
Require-notes: yes
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.dE>
Acked-by: Albert Rossi <arossi@fnal.gov>
Patch: http://rb.dcache.org/r/7006/
namespace: Improve error message in upload cancellation

The error message was a bit misleading.

Target: trunk
Require-notes: no
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.de>
Acked-by: Albert Rossi <arossi@fnal.gov>
Patch: http://rb.dcache.org/r/7007/
Fix rendering of negative numbers in columm layout

Target: trunk
Require-notes: no
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/7008/
srm: Use srm.enable.space-reservation rather than dcache.enable.space-reservation

Target: trunk
Request: 2.9
Request: 2.8
Request: 2.7
Require-notes: yes
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: http://rb.dcache.org/r/7009/
pom: update jglobus library

a bugfix build of jglobus:

Changelog for v2.0.6-rc5.d..v2.0.6-rc6.d
    * [7429aa2] gridftp: Propagate FTP failure reply in client
    * [d734763] fix handling of DN with comma as per rfc1779

Ticket: #8285
Ticket: #8312
Acked-by: Paul Millar
Target: master, 2.9, 2.8, 2.7, 2.6
Require-book: no
Require-notes: yes
webdav: switch activity logging to NetLogger format

Update logging of http/webdav activity to use the new NetLogger format.

Target: master
Patch: http://rb.dcache.org/r/7013/
Acked-by: Gerd Behrmann
info-provider: fix works-by-accent bug when importing dCache config

The info-provider uses XML Entities to import dCache configuration.
The xmllint documentation, a used to work around a limitation in
Xerces, describes how a command-line option is required for it to
honour such Entity imports; however, earlier versions of xmllint did
not enforce this restriction and the info-provider worked despite
mistakenly omitting this option.

Mitigation against CVE-2014-0191 was achieved by fixing xmllint, so
enforcing the documented behaviour.  This change broke info-provider
with the following error being displayed:

/usr/share/dcache/info-provider/glue-both.xml:35: parser error : Entity 'dcache.paths.etc' not defined

This patch adds the option to tell xmllint to honour Entity imports.

Target: master
Patch: http://rb.dcache.org/r/7018/
Acked-by: Tigran Mkrtchyan
Request: 2.9
Request: 2.8
Request: 2.7
Request: 2.6
Request: 2.2
dcap: ensure that we remove session on DoorTransferFinishedMessage

does not fix, but ensure that we do cleanup in case of:

java.lang.NullPointerException: null
        at diskCacheV111.doors.DCapDoorInterpreterV3$SessionHandler.sendReply(DCapDoorInterpreterV3.java:963) ~[dcach
e-dcap-2.8.4.jar:2.8.4]
        at diskCacheV111.doors.DCapDoorInterpreterV3$IoHandler.doorTransferArrived(DCapDoorInterpreterV3.java:2398) ~
[dcache-dcap-2.8.4.jar:2.8.4]
        at diskCacheV111.doors.DCapDoorInterpreterV3.messageArrived(DCapDoorInterpreterV3.java:2695) ~[dcache-dcap-2.
8.4.jar:2.8.4]
        at diskCacheV111.doors.DCapDoor.messageArrived(DCapDoor.java:354) ~[dcache-dcap-2.8.4.jar:2.8.4]
        at dmg.cells.nucleus.CellAdapter.messageArrived(CellAdapter.java:994) ~[cells-2.8.4.jar:2.8.4]
        at dmg.cells.nucleus.CellNucleus$DeliverMessageTask.innerRun(CellNucleus.java:1070) ~[cells-2.8.4.jar:2.8.4]
        at dmg.cells.nucleus.CellNucleus$AbstractNucleusTask.run(CellNucleus.java:975) ~[cells-2.8.4.jar:2.8.4]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_55]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_55]
        at dmg.cells.nucleus.CellNucleus$1.run(CellNucleus.java:687) [cells-2.8.4.jar:2.8.4]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
21 May 2014 04:42:04 (DCap-dcache-door-cms19-<unknown>-57629) [] Uncaught exception in thread DCap-dcache-door-cms19-
<unknown>-57629-0

kills active transfers page with accumulated transfers

Acked-by: Paul Millar
Target: master, 2.8, 2.9, 2.7, 2.6
Require-book: no
Require-notes: no
dcap: do not call toString() on error object

use String.valueOf() to handle null object as well.

Acked-by: Paul Millar
Target: master
Require-book: no
Require-notes: no
gplazma: authzdb add test case

the authDb plugin supports mapping username principals to multiple gid
principals. But there are no test that verify that functionality.

This patch adds such a test.

Ticket: 7681
Acked-by: Paul
Target: trunk
Require-book: no
Require-notes: no
scripts: allow java8 runtime

Acked-by: Paul Millar
Target: master, 2.9, 2.8, 2.7, 2.6
Require-book: no
Require-notes: no
admin: Make prompt bold

Bold is a little easier on the eye than green. It is also how
we render the font in our other interactive CLI tools.

Target: trunk
Require-notees: yes
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: https://rb.dcache.org/r/7014/
billing: Add date range and json/yaml output for billing search tool

Adds the --since and --until options to the billing search command.
Also adds JSON and YAML output options.

The JSON and YAML formats should not be expected to never change. We
may adjust the format in future versions.

Target: trunk
Require-notes: yes
Require-book: yes
Acked-by: Tigran Mkrtchyan <tigran.mkrtchyan@desy.de>
Patch: https://rb.dcache.org/r/7010/
cells: Minor cleaning of CellPath and CellAddressCore

Computes better hashes. Reduces cost of reverting CellPath.

The precomputed hash in CellPath is kept for backwards compatibility.
It can be dropped in 2.11.

Target: trunk
Require-notes: no
Require-book: no
Acked-by: Tigran Mkrtchyan <tigran.mkrtchyan@desy.de>
Patch: https://rb.dcache.org/r/7028/
system-test: Make log configuration more similar to production config

Target: trunk
Require-notes: no
Require-book: no
Acked-by: Paul Millar <paul.millar@desy.de>
Patch: https://rb.dcache.org/r/7033/