Increase Jenkins slave syslog max message size.

To better capture python tracebacks with syslog set the rsyslog
$MaxMessageSize to 64k. This change is being made to better accomodate
devstack-gate logging after we have stopped archiving the devstack
screen logs.

Change-Id: Ibb01f759f111d924a21c20f8521ea5db4a35e676
Reviewed-on: https://review.openstack.org/21233
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
gate on postgresql

now that keystone and nova bugs on postgresql have been fixed,
and pg runs are constistently green, turn on pg gating, to prevent
bugs from slipping back in.

Change-Id: I1fbed41393b9908b602739be56839aa7959b07e8
Reviewed-on: https://review.openstack.org/21071
Reviewed-by: Davanum Srinivas (DIMS) <davanum@gmail.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Kurt Taylor <krtaylor@us.ibm.com>
Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
Add summit.openstack.org to OpenStack infra

Add summit.openstack.org to OpenStack infrastructure. The current host
used is an old forgotten 11.04 cloudserver from pre-Foundation days.
We'll need to move summit.openstack.org A/CNAME to this new instance.

This host will be fully automated with its own Puppet module sometimes
during Havana, but for the urgent Portland summit setup it will be set
up manually.

Change-Id: I80a46e5969c27e540278a51d176a536e7777f005
Reviewed-on: https://review.openstack.org/21302
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
remove unneeded periodic jobs

remove full tempest private hourlies and public dailies as we're now
running full tempest on all of tempest and core projects.

now that postgresql is in the tempest gate, and running on every
core project in non-voting, we don't need a periodic job for that
either.

Change-Id: I3dd73cb71bb53532524030f5dc7f0dbdc71c62a7
Reviewed-on: https://review.openstack.org/21212
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
Open port 80 on summit.o.o and add ttx.

* manifests/site.pp: Change the summit node to be an instance of the
new summit class rather than the more generic server class.

* modules/openstack_project/manifests/summit.pp: Add a new summit
class based on server, but open 80/tcp and realize an account for
ttx. Also explicitly list 22/tcp even though it's already included
by the server class.

* modules/openstack_project/manifests/users.pp: Add an entry for ttx
with his name and SSH public key.

Change-Id: Idc4f0f30a89da12eeb8ee770e0ba0f0a2978bf5f
Reviewed-on: https://review.openstack.org/21430
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
Fix static.o.o log compression cron job.

* modules/openstack_project/manifests/static.pp: The gziplogs cron
job was erroneously configured to run ONCE EVERY MINUTE in any hour
divisible by 6 because the minute parameter was left unspecified and
Puppet was defaulting it to "*". This was not apparent until after
the cleanup and resizing work on the server sped this job up to the
point where it no longer took more than an hour to complete. This
change sets it to "0" instead, so it runs at the top of any hour
divisible by 6. Also, exclude /srv/static/logs/robots.txt while
we're at it, since it was causing a lot of cronspam and shouldn't
have been compressed anyway.

Change-Id: I7713625dbd2654b8a42b61bd69c3080c77f613c2
Reviewed-on: https://review.openstack.org/21521
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
Minor launch documentation improvements.

* launch/README: Demonstrate use of the nova client's image-list
and flavor-list features, to assist in selecting/confirming image
and RAM choices for passing to launch-node.py. Also improve the
section headers and add a section about activating the Puppet agent
on non-Jenkins-slave servers.

* launch/launch-node.py: Upon successful completion, display
parameters useful for subsequent DNS assignments.

Change-Id: I0defc62434ab2f60b23afe2048e8093614ca49ca
Reviewed-on: https://review.openstack.org/20923
Reviewed-by: Khai Do <do.khai@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
Enable gating of diskimage-builder

Uses the standard OpenStack tox methods to run tests and build
artifacts. Diskimage-builder recently added support for all of them
except sphinx, as diskimage-builder does not have any sphinx docs.

Change-Id: I948ce91836edadf526b0846218854b47f4bb1c34
Reviewed-on: https://review.openstack.org/21190
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
Make pep8 a canary build.

For check jobs, build pep8/pyflakes before trying to
build unittests. This should cut down on running tests
on stuff that isn't going to pass muster at all quickly.

For projects that use pyflakes, make that the canary.

Leave gate jobs alone, since the likely hood of rebase
introducing pep8 errors is pretty low.

Change-Id: I739f55d3fc5acb113cf5851a63ba1bcbfbf440f3
Reviewed-on: https://review.openstack.org/21267
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
Publish oslo-config tarballs

It looks like oslo-config isn't set up to publish tarballs. There is
no master tarball on tarballs.o.o and the 2013.1b tag I pushed
didn't cause a pre-release tarball to be generated.

Change-Id: Ida97da5def80c03da7e020df941d681464ec993b
Reviewed-on: https://review.openstack.org/21599
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
Modify Stackforge Libra project permissions.

Add permissions to create new branches and tags and to WIP.

Change-Id: Id53d6649a17e99f8a77da5f51003d135ca3492a3
Reviewed-on: https://review.openstack.org/21693
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
Compress elasticsearch stored fields.

Configure elasticsearch to compress stored fields and the term vector.

Change-Id: Ic7f40e18fc950056abd84e083b5d9abb69e38dbe
Reviewed-on: https://review.openstack.org/21138
Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com>
Reviewed-by: Khai Do <zaro0508@gmail.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
Add ask server.

Later we'll add the public keys for the askbot folks.

This will be mostly managed outside of puppet for now.

Change-Id: I5de4a164932ce87c1d4c329c8e839e979c271fa1
Reviewed-on: https://review.openstack.org/22047
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
Add hpcloud-az3 devstack-gate provider.

Add hpcloud az3 as another devstack-gate Jenkins' slave provider. This
will further diversify the devstack-gate availability zones decreasing
the effects of AZ specific problems.

Change-Id: Ie35574ff6d06753d69b596c59234b26437ad5f7e
Reviewed-on: https://review.openstack.org/21902
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Khai Do <zaro0508@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Add baremetal DB migration test database.

Fixes bug 1130451

Add a second MySQL DB that the openstack_citest user has permissions to
to facilitate baremetal DB migration testing. This is necessary because
testr runs changes in parallel so each MySQL test needs individual DB
schemas. Long term we should come up with a better way of negotiating DB
access but in the short term this is quick and simple.

Change-Id: I4ee207bc3c2bf9d5d8c48409c2c611d17225994a
Reviewed-on: https://review.openstack.org/22387
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Directly create the baremetal test database.

mysql::db assumes it has to create the user given to it each time it is
invoked. This break when you want to give one user access to mulitple
DBs. To work around this directly create the new DB and grant
permissions to it using the types provided by the puppetlabs-mysql
module. This change was made copying what mysql::db does[1].

[1] https://github.com/puppetlabs/puppetlabs-mysql/blob/0.5.0/manifests/db.pp

Change-Id: Ie45c1bd6f276bfbbc776e816cb5957a7fe808882
Reviewed-on: https://review.openstack.org/22393
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
Increase python unittest timeout to 40 minutes.

The python unittests (particularly python26) have been getting close to
the test timeout and occasionally go over. Increase the test timeout by
10 minutes for a timeout of 40 minutes. This is approximately the length
of time that tempest-devstack-gate-vm tests take to run so should not
increase the runtime for a change in the qate.

Change-Id: Ic2c015ad87968a6885c9bbc82fed5f37b3aee209
Reviewed-on: https://review.openstack.org/22397
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
Restore previously inapplicable sentence from ASF.

* modules/openstack_project/files/gerrit/cla.html: At the request of
Jonathan Bryce, Executive Director for the OpenStack Foundation,
this change updates the OpenStack Project Individual Contributor
License Agreement with a "public benefit" statement taken from the
Apache Software Foundation's ICLA. This sentence was previously
inapplicable under OpenStack LLC but can now be restored under the
OpenStack Foundation.

Change-Id: I944e1d361af8f0faaed0dc88ded216451b72e4b3
Reviewed-on: https://review.openstack.org/22396
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
Add a dedicated slave to launch devstack nodes.

So that we can take this load off of the jenkins master.

Change-Id: Id66efede75fab9977013e69f3415a53dc239b0ce
Reviewed-on: https://review.openstack.org/22379
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
Revert "Add ask server."

This reverts commit 484a034118b55c44fd37bd066fb4f2ffd1cc39f5

Management is outsourced to the askbot folks.

Change-Id: I36c67211c078ac0cda4f8e4eca7f49c17cea40b2
Reviewed-on: https://review.openstack.org/22338
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins