Fix Swift config for Ceilometer usage

Ceilometer filter was previously removed from the Swift
configuration to avoid useless Ceilometer logs in the Swift
ones. This was fixed by setting only warning log level for
this Ceilometer part of the pipeline to keep only important
ones.

Change-Id: I8c41355bb98dbf3bb59ec792221b05ea936086b7
Partial-Bug: #1294789
Switch to Fedora-x86_64-20-20140618-sda

The heat-slow job using the Fedora-20 image as L2 guest, the
currently used version is affected by the heartbleed issue and
the Mb-Bios bug issue observed with emulation.

This version of the  Fedora cloud image uses the no_timer_check
kernel parameter, which solves the MP-Bios Bug issue.

The Image tested with ~3000 heat-slow job, without any issue.

Change-Id: I9ce9b7769c2d91e630b0362f2c2c6ac9066defbc
Closes-Bug: #1312199
Closes-Bug: #1297560
Revert "Build retry loop for screen sessions"

This reverts commit 0afa912e99dc9bad8b490960beb8f0cf85750dcc.

This possibly made things worse, though it times in with the
trusty add, so it's hard to tell. Revert to see if grenade gets
better.

Change-Id: Ic399957fc9d4a7da28b030cdf895df061b2567c8
Related-Bug: #1331274
Add libyaml-devel package dependancy

Without libyaml-devel package installed (on Fedora-20),
running ./stack throws:

  [. . .]
  build/temp.linux-x86_64-2.7/check_libyaml.c:2:18: fatal error: yaml.h:
  No such file or directory #include <yaml.h> ^ compilation terminated.

  libyaml is not found or a compiler error: forcing --without-libyaml
  [. . .]

Adding this dependency to files/rpms/general resolves it. Also added to
files/apts/general.

Change-Id: If1aa23bf3fc76ea2b321c3725dd07050ddd4b825
Do not clean docs directory

The docs/source has been introduced by change-id:
Ide5f7d980a294c7a9f8a3decaed0939f1c239934, but clean.sh try to clean
whole docs direcotry, which is not right.

Meanwhile, there are directories in FILES_TO_CLEAN variable, which means
rm -f will not work. We need to use rm -rf.

Change-Id: I4e10d70d5638ce7e7a9215f5bd848422aa90aad3
Closes-Bug: #1335399
Only enable auth_token in swift with keystone

We don't need to enable auth_token in pipeline when we don't have
keystone enabled.

Change-Id: I4695817766fc39fcceed32f71156d4123d5bdfa1
Add keystone middleware to devstack

Add the keystonemiddleware repository to devstack to support testing
with tempest and stable branches.

Change-Id: Ib635465e6568d9cd51d6e432ec8b8633a27d19ce
fix trove image addition

the previous addition to trove was done in a way that it was not
possible to discover from nodepool. This fixes our ability to do
that, especially with non-default on services.

Change-Id: I8ca682354e0d4e2eb9cf05f40c6dd783de1c6355
Adds support for multi-region

Change-Id: Ib85fe7cb375692b04aca4c46f61ba7e1fbfa501b
Implements: blueprint multi-region
Avoid huge libvirtd.log files on Ubuntu hosts

The libvirt log filter settings match against the filename of
the libvirt source emitting the log message. Normally these
file names are relative to the source tree root, but in the
Ubuntu binary packages these have somehow ended up as absolute
filenames from the OS root. This means that a log filter of
'1:libvirt' which is only intended to match src/libvirt.c
will in fact match every single file. This caused enourmous
log files on Ubuntu hosts running the gate.

The fix is to use '1:libvirt.c' as a more specific filename
match, but we can't do this unconditionally because libvirt
>= 1.2.3 does not use filenames for log filter matching
anymore. So only change the match on Ubuntu hosts for now,
since that's where the original problem lies.

While doing this, also turn off the logging of object ref
and unref operations, since those pollute the logs with lots
of noise.

Change-Id: I71b67507a4e68a7bff0c358857aaaac08ef0c420
Add ability to enable OSprofiler

To enable OSprofiler we should be able to add "profiler" notification
topic to ceilometer notification topics.

More about OSprofiler:
https://github.com/stackforge/osprofiler

More about ceilometer plugin:
https://review.openstack.org/#/c/100239/

Sample of trace (via Cinder and Nova Services):
http://pavlovic.me/rally/profiler/

Change-Id: I6137174a3ecddd58f62e0f98b235b71b1c070f13
Install oslo.i18n from source

Add a step to install oslo.i18n from source.

Change-Id: Ie041d4b82ca75a1c2ff99563a7a87447adc57ad2
Fixed tunnel ranges variable inconsistency.

Change-Id: I7108a3ebd597e1dc808917be9213457df2322100
Generate recent changes list from git log

The list of recent commits to the DevStack repo is now generated
by tools/build_docs.sh from the last 6 month of the git log.

Change-Id: Idefdb5d5188ab7e743af131e3d6cb132382d25d4
Lower default IRONIC_VM_SPECS_RAM

Revert the default required RAM for Ironic nodes from 1024MB to 512MB.
Ironic now passes a kernel parameter to deploy ramdisks that avoids use
of tmpfs and lowers minimum memory requirements.

Change-Id: I20226c496fdd06ecfc6769a60b6d6f82887130a8
Revert "Add missing config option os_auth_url"

This reverts commit 524bbed05ce9de0bd711aa18c35afa4476978404.

Change-Id: I0dc3ec7a55cb65bd2a5ff76f32b3d99f8962597b
Update Apache + mod_wsgi deployment mechanisms

Added a global toggle for enabling HTTPD + mod_wsgi for services
that default deploy to running under Apache. When the variable
``ENABLE_HTTPD_MOD_WSGI_SERVICES`` is set to ``True`` any service
that recommends deploying under HTTPD + mod_wsgi, will be run
under Apache.

If ``ENABLE_HTTPD_MOD_WSGI_SERVICES`` is set to ``False`` the
any service that is defaulted to running under HTTPD + mod_wsgi
will (if capable) be run in an alternate deployment strategy (e.g.
eventlet).

Updated Swift and Keystone to have individual toggles for deploying
under HTTPD + mod_wsgi. This is done to allow for gate to run on
the services under mod_wsgi where appropriate. Toggles are
``KEYSTONE_USE_MOD_WSGI`` and ``SWIFT_USE_MOD_WSGI`` and are both
defaulted to "False" (do not deploy under HTTPD + mod_wsgi).

Change-Id: Id3b121b8f1cde369d184b586e0d875bdbda34813
Enable Keystone under Apache by default

Make the default run mode of Keystone HTTPD + mod_wsgi. This will
enable gating on Keystone under mod_wsgi.

Depends On: https://review.openstack.org/#/c/100764/

Change-Id: I4b664a1d6c9bbb1ff999158f3a8c8ab3bd8d891b
Configure rabbitmq credentials in keystone.conf

Rabbitmq credentials in keystone.conf should be updated according
to localrc

This is done mostly to enable keystone notifications.

There are 2 cases where we can use notifications from keystone:
A) Collect audit notifications in ceilometer
B) Collect profiling data

Change-Id: I381d4d670755aa691743caa02df7dc55e05784c2
Add pre-install phase for extras.d plugins

An additional call hook for the extras.d plugins that is called before
any service installation occurs turns out to be needed by Ceph and
useful for other plugins.

This is called between the installation of the system packages listed
as prerequisites and the installation of the actual services.

Change-Id: Id723bdc7542182d2b2eff40c0dc0127307f094c5