Move keystone logs over to oslofrmt

After the successful implementation of
https://blueprints.launchpad.net/keystone/+spec/unified-logging-in-keystone
keystone uses oslo logging instead of its own. Update logstash settings
to reflect this.

We currently don't have any keystone logs in logstash, this should fix
that.

Change-Id: I7acfa35bfd112a15d2ec3aa7338fb28b37a827cb
Add a magnetodb job for cassandra integration tests

Change-Id: Ic72c0bb47b6a380a12660189bea0a5ea511e15fc
Implements: blueprint move-cassandra-tests
Install Zuul onto workers

So that we can use zuul-cloner, install Zuul into a venv.  We can
invoke it with /usr/zuul-env/bin/zuul-cloner.

Change-Id: Id97b967cea2d3e476334f51525a036c7c7e43762
Adding windows disk image builder tool for tripleo on stackforge

This is implementation of tripleo blueprint as ci is not possible
for this tool as of now. we want it to go in stackforge.

Change-Id: I476733500332fbfe3ad7e50fa2ef4b1d3fd2ac4a
Publish individual files in IPA post job

Consuming the tarball directly in devstack required devstack understand
too many specifics about the layout of the interior of the tarball.
Uploading the files independently allows devstack to pull them down and
put them in glance directly.

Once everything has been migrated to pull the individual files down,
I'll push another merge request to stop publishing ipa-coreos.tar.gz.

As a note, this is part of the larger effort documented here[1] to get
IPA in the Ironic gate.

Once this is merged, https://review.openstack.org/#/c/117384/ will be
updated to utilize IMAGE_URLS and existing tooling to get IPA ramdisks
into glance.

1: http://lists.openstack.org/pipermail/openstack-dev/2014-August/
   042357.html

Change-Id: Ifa0b450d37d57b5eded3f8260f895cd9e97fd39e
Add the tempest-lib project to openstack

This commit adds a new project for the tempest library to openstack.

Change-Id: I74e3911c18d6e633c8cd502e8b980b15106ccc53
Reduce graphite's stats retention policy

In order to make more efficient use of disk space, let's change the
default retention policy. Being able to react to changes with a
10-seccond precision less likely to be usefule as the data gets older,
and our historic data does not give much insight beyond a 1-hour
precision.

This change does not effect already created metrics, changing that would
require a manual run of whisper-resize.py on the data directories. This
only effects new metrics.

Old retention:
  10-second precision for 6 hours
  60-second precision for 7 days
  10-minute precision for 5 years

New retention
  10-second precision for 8 hours
  60-second precision for 7 days
  1-hour precision for 1 year
  1-day precision for 5 years

Change-Id: I08d73d092fc73c271e9092f551f38f395e006ca4
Make puppetdb_server name configurable

Allow puppetdb_server varible to be changed outside the manifest.

Change-Id: Ifab7d4fc3090882458054082aa1ea4fd839019ef
Typo: replace puppet.rsh by ref to puppet-master

There was a buggy file name puppet.rsh in documentation. Convert
that to a reference to puppet-master

Change-Id: I18898c41161b5b79be8ff799be2390d97dc54701
Add missing oslo projects to gerritbot config

Change-Id: If057fb2d20a1c485e94b2eab4880225928e6578c
Add docs jobs for some oslo projects

Some projects were missing jobs to build/publish docs

Related-Bug: #1364141

Change-Id: I7d191ab2d6d15785efb95839d09be727534fab35
Templatize puppet projects in layout.yaml

Introduce new job-group puppet-check-jobs for jjb and use it everywhere.

Introduce new templates puppet-check-jobs and puppet-module-unit-jobs
in layout.yaml and use them where possible.

Change-Id: I6d827f7d381fb37516bf78cd9c0ca2570ba258f6
Fix doc8 issues

Remove extra whitespace.
Wrap overlong lines.
Remove extra ".." in one place

Change-Id: Ib7280a87ddb663a8ab27308ffd67d19f0b0f7b09
Fix chef gates, allow sudo for gem install and use ruby 1.9.1

* We need to install system gecode 3.x libraries which requires sudo.
move revoke sudo step to below the bundler-prep step to allow that.
* We need to use ruby 1.9.1.  A previous commit removed the ruby1.9.1
prefix (see bug)
* Cleanup repo to use common builders

Change-Id: I7622cd939a26c29712d89dded8d2657ce25f3a82
Closes-Bug: #1357439
Dependencies to install python-cinderclient

One more package is required to install python-cinderclient from source:
* libxslt1-dev

Without that package compilation fails because of missed header file.

Change-Id: I8023697ad06c5fb880024d0c992a5e557a399122
Merge "Publish individual files in IPA post job"
Merge "Add a magnetodb job for cassandra integration tests"
Switch taskflow to use the unittests slave script

Instead of using the tox slave script which doesn't report back
very meaningful (if any) testr results to review system use the
unittests one which does provide this information just like the
standard jobs.

Closes-Bug: 1273850

Change-Id: I11ff92ed719f665064336a1fcf8111d1d652e991
Watchdog class will not be installed in logstash_worker class anymore

Change-Id: I68b48fd26eae73775d2e5200acd29dc1c375047e
Update sideways Ironic job

Sideways Ironic job is currently using the default libvirt driver on
the new side of the upgrade.  This sets the required virt driver
in the job.  This also enables Neutron for the job, which is required
for the devstack Ironic deployment.

Change-Id: I3118cb3322a93ad5873074765f6eef6c9d9c4acb