Run gate-{name}-docs on infra-publish-jobs

The gate-{name}-docs publishes a draft copy of the docs for reviewers.
Published draft documents clearly aren't needed for gate jobs, however
this test will ensure that the docs still build correctly when merged.

Change-Id: I454103b5d5262d4aaeb6671b79892be7993bb2a6
XenServer: Add XenServer support

Upstreaming several changes from XenServer CI:
 - Use tty0 as console - thus the user can see what's happening during
   installation over VNC console.
 - Set the number of VCPUs to 6 for the DomU appliance
 - Add prepare_node_xenserver.sh script.
 - Use testing xva 1.1.4 which has trusty.

Change-Id: I56fc4e1af12f3f13fd1aa0b772bd8734b412d3d5
Remove oldmanual setting from projects.yaml

Change I39f93f67b96961cd9991b6a13fecddb16e3a20fa remove the usage
of oldmanual but not oldmanual itself.

Remove it, it's not used anymore.

Change-Id: I221d37d74c400d0e2a412ec2f56af84c36c83892
Delete delete-project-gerrit-plugin jobs

This is not used at all, thus remove it from our queues.

Change-Id: Idae1fd13a7db1d2ff2bdbf59c2f17f8af73fc8e6
Note: this currently fails in the periodic queue.
Merge "Remove oldmanual setting from projects.yaml"
Improve tools/layout-checks.py

Instead of hard-coding first entries, use the section headers directly.

Make the output a bit nicer.

Change-Id: I0a5f947d42ada5f010853de04f3ca651039eeb60
Fix several HTML issues and prettify syntax

According to the markup validation service provided by the W3C there are severl
HTML issues. This patch fixes all of them and prettifies the syntax.

http://validator.w3.org/check?uri=specs.openstack.org&charset=%28detect+automatically%29&doctype=Inline&group=0

* No Character Encoding Found! Falling back to UTF-8.
* No DOCTYPE found! Checking with default XHTML 1.0
  Transitional Document Type.
* No Character encoding declared at document level
* Line 4, Column 8: element "HEAD" undefined
* Line 5, Column 11: element "TITLE" undefined
* Line 27, Column 38: document type does not allow element "body" here
* Line 206, Column 9: end tag for element "BODY" which is not open
* Line 207, Column 7: end tag for "div" omitted, but OMITTAG NO was specified
* Line 207, Column 7: end tag for "body" omitted, but OMITTAG NO was specified
* Line 207, Column 7: end tag for "html" which is not finished

Change-Id: I1909fc2fb225063d29a04bda99cbbc6a82411573
Further coverage cleanup

Delete coverage jobs that are not setup properly at all, those that will
always fail. Examples are missing environments, missing scripts or
missing installed packages.

I did not delete jobs that were successfull but didn't collect any data
or those that failed for any reason.

Change-Id: I75299f7ef186bae4596ce2c6b5579b7e82813255
Add buildimages job for Sahara

It's only in check pipeline, non-voting and for master branch.

Change-Id: Ib2bb2ce5f60de733cecde0396dbc1b00e692dc5a
Add bashate job to sahara-image-elements

Change-Id: Iac45738ba7b8148e4d98153da6fba355adced66d
Use git farm for layout job cloning

It has been witnessed that at least occasionally Gerrit's local
mirror can fail to return data for a clone request. Instead clone
these additional projects from our awesome Git server farm.

Change-Id: Iddf8cdab8b0766a7b7ec6c2d4171708fd3c49685
Trigger requirements run for requirements-py3.txt

The gate-.*requirements jobs are only triggered if certain files change.
Some projects have requirements-py3.txt or test-requirements-py3.txt.
Include as triggers all versions that the file update.py from the global
requirements repository handles.

Change-Id: Ib77229e7cc358059a6b3d6bcae0016959741db9d
Use templates in layout.yaml

Use python3-jobs, puppet-check-jobs and pypy-jobs templates where
missing and applicable.

Remove extra gate-oslo.vmware-requirements, it's part of
check-requirements template.

Change-Id: Iac9ee6ef72090ac1496ba0b95d88346e681f8831
Add manifest build to groups portal release job

Generate a manifest file during groups portal release job
to enlist the available development and production release
information for third party Drupal deployment tools like drush.
The manifest file will be published under
http://tarballs.openstack.org/groups/drupal-updates/release-history/groups/7.x
url.

Change-Id: I48f694cbc2ea46d41a10aafb8b51ebb0a50f7ef4
Add facter package to uninstall-puppet macro

Although rspec tests for Puppet modules are running in bundler,
the system version of facter looks to conflict with rspec tests:

    ArgumentError:
      Invalid facter option(s) type

This hypothesis has been confirmed on a system with a similar setup.
Uninstalling the system version of facter fixed the above problem.

Change-Id: I24fc6607f27f013d63903f6e709a5ce266495287
Add neutron-drivers team for approving specs.

Neutron is creating a separate team to approve specs, this commit
adds the group in gerrit.

Change-Id: I635e9fabd3f643803fa00ea4cf26ef2e6fb95526
Enable Keystone extensions for OSC functional jobs

Devstack already has code to setup extensions for Keystone;
OpenStackClient has command support for these extensions.
Let's enable these extensions in DevStack before firing it up,
so we can add functional tests for them.

Change-Id: I8833c2421ff28454134854dd8570743f5b33248e
Change paths in rally-jobs according to new layout

Directory tests_ci moved to tests/ci

Change-Id: Ib041499f9cc4c52dd7b417b4fe82ef0eb2e11ad5
Add check for ordering of jenkins/jobs/projects.yaml

Example output of test:
$ tools/jenkins-projects-checks.py
Checking section 'OpenStack server projects'
Checking section 'OpenStack client projects'
Checking section 'oslo libraries'
Checking section 'Other OpenStack projects'
  Wrong alphabetical order: tempest, qa-specs
Checking section 'OpenStack API projects'
Checking section 'OpenStack documentation projects'
Checking section 'OpenStack development projects'
Checking section 'OpenStack infrastructure projects'
Checking section 'Stackforge projects'
Found errors in jenkins/jobs/projects.yaml!

This patch fixes the order so that it passes.
It also creates a new job to test this.

Change-Id: I36fd522261363494f07b57e40f0d9b943cf08841
Merge "Add buildimages job for Sahara"