Archive Ironic VM nodes console logs

Set log directory in localrc for Ironic deployment and archive these
logs as part of cleanup_host().

Change-Id: Ia99e5b22cc43124c582369b7ddaf0455d2d606e4
Capture apache configuration files

Capture the apache vhost files in the output from ds-g. Since we
have more than just horizon's configuration, it is useful to know
how the Apache server is running / errors in the vhost when a
check or gate job finishes.

Change-Id: I1e5a7b5086566c0cbd18dee92c5062773ce8a8e5
Make one copy of grenade log files

Change 709f2349 removed the blanked 'rm' of grenade log files, but
that leaves behind several confusing entries in the final log output;
e.g [1].

---
 grenade.sh.log.2014-06-16-014311
 grenade.sh.log.2014-06-16-014311.2014-06-16-014311.summary
 grenade.sh.log.summary
 grenade.sh.txt
---

grenade.sh.txt is greande.sh.log renamed, which was a symlink to the
time-stampped file, which is no longer removed.  The summary files are
also duplicated and not directly visible because they do not have a
.log extension.

This change just keeps the grenade log and summary files.  It renames
the summary so it can be viewed, and removes the unnecessary files.
It also puts grenade's localrc in the top-level directory with the
logs, renamed to grenade_localrc

[1] http://logs.openstack.org/83/98283/2/gate/gate-grenade-dsvm/8ba1473/logs/

Change-Id: I932ee1583f04756579abf63c792d336ae937f64d
Merge "Archive Ironic VM nodes console logs"
Merge "Make one copy of grenade log files"
Handle proposed/ branches in test-matrix.py

We are now cutting proposed/* branches on projects. Test matrix needs to
know about them. Test proposed/foo* as if it were a stable/foo branch
when we know what foo is. If we do not know about foo fallback onto
testing with a master setup as this branch is an intermediate non
integrated release (eg swift proposed/2.0.0) which is released while
other projects are still developing on master.

As part of this change update features.yaml to teach it about juno in
prep for the upcoming juno release.

Change-Id: I3f72d3171d0a1afc00298b1761c06b77bb282a6b
Merge "Capture apache configuration files"
Update toggle variable for HTTPD + mod_wsgi services

Update the devstack-gate toggle variable to match the new global
toggle for running services under alternatives to HTTPD + mod_wsgi.
This toggle only affects services that default to running under
HTTPD + mod_wsgi.

The new toggle was added in: https://review.openstack.org/#/c/101611/

Change-Id: I7ebaebf7806049fee2a6e57df628ad934b6d494c
Stop doing tricky things with mirrors

With a bandersnatch mirror, we don't need to run mirror selection
scripts.

Change-Id: Ia48368cad1d4bfbe1aeec607ee8a6e2443ebb936
No more thinging in functions.sh

The debugging line of "NProc things we have <N> cpus" is badly
worded, and contains a typo. Re-word it in a way that doesn't
make people twitch.

Change-Id: Ic3dd586081750526398fd6d95b54d71bffd8ccd9
add os-loganalyze to projects list

This lets us include it in devstack.

Change-Id: Id3da21b8d6dc9dec9f671427998597f77419cb60
Merge "Stop doing tricky things with mirrors"
Merge "No more thinging in functions.sh"
Merge "Update toggle variable for HTTPD + mod_wsgi services"
Add setting for INSTALL_TESTONLY_PACKAGES

Some jobs need to have the test packages installed, such as
check-swift-dsvm-functional.

Change-Id: Iac538c07cd33f130ccb33f3b2ca8c92a17568553
closes-bug: #1341507
Use different passwords for different tasks

This way, we can find problems with using the wrong variable

Change-Id: I03219e0ba5dfbf27801f65995cb8521db7c2c382
Move PATH set earlier

Checking the logs for a f20 run you'll see

---
 + ./safe-devstack-vm-gate-wrap.sh
 sudo: service: command not found
 22 Jul 21:24:41 ntpdate[1551]: adjust time ...
 sudo: service: command not found
---

We already went through this path issue with [1] so just move it
earlier before anything runs

[1] https://review.openstack.org/#/c/91655/

Change-Id: Ie6bd27342b0ba0f0fba0a1d3695f108128d4366e
Gather Apache2 error log

Change-Id: Iceb4a00b99a241e8dbb1510c2426f4f69f48ea51
Debug 'Cannot allocate memory'

Several jobs fails with [OSError] Cannot allocate memory,
but it is not clear why. Is  it caused by multiple run away process,
or just on process become fat.

Adding line to cleanup_host to save the final process list including
the memory usage.

Change-Id: Ic7455d689869092703974512d14bd121e4b44f1b
Merge "add os-loganalyze to projects list"