Minor fixes in Ceilometer benchmark scenarios

1. Renames ceilometer.py to alarms.py as it contains scenarios for alarms only.
2. Complete a TODO to use self._generate_random_name

Change-Id: I536e0ebd20f8dc56e31a75f117994c3abe4c9f2d
Closes-Bug: #1323629
Changes tempest subunit log handling

* Remove subunit2junitxml dependency and code from rally
* Convert raw subunit stream from tempest tests to json and store only
  json in DB
* Run tempest scenario (smoke) in rally gate

Change-Id: I6628375d83da9af3984819dfc5815ae0c06ec1aa
Implements: blueprint tempest-subunit-to-json
Refactor tempest config generator

Use `requests` library instead of `urllib2` & `httplib`
Main profit from `requests` library:
- `requests` is HTTP for Humans;
- `requests` is well documented[1];
- `requests` can save downloaded files by parts, so usage of memory
is less(useful when downloading big data, for example - some images)
- `requests` has same name as in Python 2x and Python 3x

Use `inspect.getmembers`[2][3] for discovery of each function for section
generator. Profit : decrease lines of code

Add checks for existence of subnet in 'network' section.

Move function `_write_config`[4] from class `Tempest`[5] to `TempestConf`.
Reason: this function not related to verifier for Tempest.

Fix message for exception when user doesn't have admin role.

Move name of section into kwargs to each section function.
Profit: less string objects with section names

[1] - http://docs.python-requests.org/en/latest/
[2] - https://docs.python.org/2/library/inspect.html#types-and-members
[3] - https://docs.python.org/3.3/library/inspect.html#types-and-members
[4] - http://git.io/E1zPOQ
[5] - http://git.io/8Ru-Yw

Change-Id: I8307ec33dd93ef055450f58d7cd55bf6b200f249
Add unit tests for rest

* add unit tests for rest.types
* add unit tests for rest.controllers.root
* add unit tests for rest.controllers.v1.root

Change-Id: Icb7d243643a6a0a57d2b1f01879774008491ea0a
Updated from global requirements

Change-Id: I1db47c96cf465e6378e783ce5240bb0b46b6c534
Merge "Add unit tests for rest"
Sync necessary modules from oslo incubator for worker service

Sync modelus: service, periodic_task and related dependencies
from oslo-incubator. Using the following command in oslo-incubator:

python update.py --base rally --dest-dir ../rally --modules \
periodic_task,service

Change-Id: I0b8278404d53a91add7a8cf3876121aad1e497c2
Benchmark to validate a keystone token N times at service endpoint

With PKI, tokens can be validated at the service endpoint. There might
be some caching policies which might affect the validation process.
This benchmark can be used to check effect of caching related to tokens.

Change-Id: I6277d8514bbdb1e5dca5032f44ac3d5ff9618cc2
Merge "Benchmark to validate a keystone token N times at service endpoint"
Add Neutron benchmarks scenario for creating and listing ports

Scenario NeutronNetworks.create_and_list_ports is added, which does the following:
  - creates network
  - creates a given number of ports
  - lists ports

blueprint benchmark-scenarios-for-neutron

Change-Id: I029f220dd70beb0c248877bd4bd718dfa63aba40
small fixes on rest/base.py

- rename a base class from FunctionalTest to PecanControllerTest which
makes this naming more accurate
- remove some print statement for debug uses
- use _request_json in delete method
- use requests module instead of six.moves.urllib

Change-Id: I4463466bab91ad538295668b9e8133a1a1f99caa
use oslo.db module

* Use oslo.db module instead of rally.openstack.common.db
* Remove rally/openstack/common/db

Change-Id: I78e29810f4bf6cc624417744dd74f15ef2281edf
Improve doc/source

Here we enhance the rst docs (used for readthedocs):
* Simplify its index structure by reducing it to only 5 points:
  1. Deploy (engines & server providers)
  2. Verify
  3. Benchmark (scenarios, engine, contexts, plugins)
  4. Command Line Interface
  5. Implementation (all source docs moved here)
* Extend the 'Benchmark' page with info from the "Main concepts" page from Wiki
* Add some introductory text on Deploy & Verify parts based on that from Wiki
* Simplify headings by removing "The" and "Layer"

Change-Id: I04bb553aba04009634272a88a757baa8f2c8c359
Adding Image Context Class

This Context Class implements Image Context Subclass
to Benchmarking Mechanism. This also adds a simple list_image benchmark
scenario which tests glance image-list command

bp benchmark-context-image

Change-Id: I272a36cebb568e8d599ebd65beb53b6a2c628b6e
Merge "small fixes on rest/base.py"
Merge "Add Neutron benchmarks scenario for creating and listing ports"
Merge "Adding Image Context Class"
Delete commented codes from test_vmtasks.py

There are some commented codes in tests/benchmark/scenarios/vm/test_vmtasks.py,
and
https://github.com/stackforge/rally/blob/master/tests/benchmark/scenarios/vm/test_vmtasks.py#L85
is longer than 80. This patch removes these useless lines.

Change-Id: I7ad67742f19c2009589d8e9d7b171a3c685c53ee
Added a test to check json<->yaml configs equality

Implemented a unit test that takes all the config pairs from doc/samples/tasks/
with identical names (e.g. nova/boot-and-delete.json and
nova/boot-and-delete.yaml) and checks that their contents are identical as
well. Also it tests that every config should have a pair (if there is *.json,
there also has to be *.yaml, and vice versa)

Change-Id: I4c0d185439e2a2c48a801fa8c62c7ed2e80a6031
Merge "Added a test to check json<->yaml configs equality"