Repository: rucio/rucio

Issue:
transfers: force S3 alternative authentication method
Motivation
----------
Currently, FTS3 requires a compatibility option to authenticate with S3 storage. This can be removed once Davix is modified to do this automatically.

Modification
------------
Set "s3alternate":True in the job_param
Documentation overhaul for the workshop
This issue is used to track the changes and todos necessary for the general documentation overhaul for the workshop.

# General tasks
## General information
- [x] Concepts and Terminology (#566, @bari12)
- [x] Architecture (@bari12) - Depending on how much needs to be done, some help might be needed here

## Developer documentation
- [x] Contributer guide (from github) - should be only one line in the TOC (@vingar)
- [x] Installing dev environment (@vingar) - Docker example written by @berghaus can be used here.
- [x] REST API description (@tbeerman) - Some general information, some examples, rest auto generated
- [x] API description auto-generated (@vingar)
- [x] CLI description auto-generated (@vingar @cserf) for rucio, rucio-admin utilities and daemons

## User documentation
- [x] Installing Rucio clients (@cserf) - Mostly already there, only docker part needs to be added
- [x] Rucio Clients howto (#551, @cserf, @TomasJavurek) - Should be a generalized version of the ATLAS RuucioHowTo
- [x] Demo section based on docker and different steps (#696 @tbeerman, @cserf) - Basically installing a server, daemons etc in docker and then doing some things in this env

## Operator documentation
- [x] General information (@mlassnig) - Different ways of deploying rucio. Dependencies (DB, Transfertool, Messaging, Monitoring)
- [ ] Docker deployment
- [x] How to configure Rucio: rses, accounts, etc (#736,  @cserf)
- [x] How to version the DB with alembic, upgrade and downgrade instructions (@mlassnig)
- [ ] (Puppet deployment)
- [ ] (Kubernetes deployment)

# Bits & Pieces
- [x] Concepts needs to be expanded with information how a replica actually works on storage, with a dataset as example; how deterministic/non deterministic works; how scopes come into play etc. (@bari12)
- [x] How to connect and configure a stroage element to Rucio (@cserf)
- [ ] We also need something about dumps and ACLs in the op documentation
- [ ] How consistency and recovery can be done
- [x] List of return codes of bin/rucio (@mlassnig)


Discussion:

Resolving patch:
diff --git a/lib/rucio/daemons/conveyor/common.py b/lib/rucio/daemons/conveyor/common.py
--- a/lib/rucio/daemons/conveyor/common.py
+++ b/lib/rucio/daemons/conveyor/common.py
@@ -6,7 +6,7 @@
 #
 # Authors:
 # - Vincent Garonne, <vincent.garonne@cern.ch>, 2012-2014
-# - Mario Lassnig, <mario.lassnig@cern.ch>, 2013-2015
+# - Mario Lassnig, <mario.lassnig@cern.ch>, 2013-2018
 # - Cedric Serfon, <cedric.serfon@cern.ch>, 2013-2016
 # - Wen Guan, <wen.guan@cern.ch>, 2014-2016
 # - Joaquin Bogado, <jbogadog@cern.ch>, 2016
@@ -168,7 +168,8 @@ def bulk_group_transfer(transfers, policy='rule', group_bulk=200, fts_source_str
                       'job_metadata': {'issuer': 'rucio'},  # finaly job_meta will like this. currently job_meta will equal file_meta to include request_id and etc.
                       'source_spacetoken': transfer['src_spacetoken'] if transfer['src_spacetoken'] else None,
                       'overwrite': transfer['overwrite'],
-                      'priority': 3}
+                      'priority': 3,
+                      's3alternate': True}
 
         if max_time_in_queue:
             if transfer['file_metadata']['activity'] in max_time_in_queue:
diff --git a/lib/rucio/vcsversion.py b/lib/rucio/vcsversion.py
--- a/lib/rucio/vcsversion.py
+++ b/lib/rucio/vcsversion.py
@@ -4,8 +4,8 @@
 '''
 VERSION_INFO = {
     'final': True,
-    'version': '1.14.8',
-    'branch_nick': 'patch-0-1_14_8_preparation',
-    'revision_id': 'a4ef2f5cc53991862d6e2efc0970ec45ff70c7d4',
-    'revno': 5846
+    'version': '1.14.9',
+    'branch_nick': 'patch-0-Rucio_1_14_9_preparation',
+    'revision_id': '0d16b4bd29d1dc7acd0d4947e8a0c32920be9216',
+    'revno': 5902
 }


Test patch: