Scenario output should have proper format in case of timeout

scenario_output should be {"error": "", "output": []} in case of timeout.

As well unify way to handle this in different runners

Change-Id: I97e77b77f16fadde4720bf96f080e1df7829071c
Closes-Bug: #1339746
Add unit tests for tempest context

Added following test cases

test_setup_failure_on_tempest_configuration
test_setup_with_no_configuration
test_cleanup_fail

Change-Id: I5367b8fc9bad87268e6275b8c54690ed91b0e0ad
Implements: blueprint improve-unit-test-coverage-rally
Add unit tests for benchmark scenarios

Added following unit tests

1. Ceilometer
test_create_and_query_alarms_no_filter
test_create_and_query_samples_no_filter
2. Dummy
t_dummy_dummy_with_scenario_output
3. Heat
test_heat_resource_is

Change-Id: I21a877a0b4d63febf3043fc7445d3bb051374093
Implements: blueprint improve-unit-test-coverage-rally
Merge "Add unit tests for tempest context"
Merge "Add unit tests for benchmark scenarios"
Fix failing unit tests

* Some benchmark validation unit tests failing due to changes in
  python-novaclient common exception class

Change-Id: I2b65564f0eadd4d7ed881e05b46cae7c8f68f190
Closes-Bug: #1340530
Sort by created at column in cli output

* Rally cli output, sort by created at column wherever required

Change-Id: Id2a1d9901d88f64d624cabc8d09b2ee362eb83c3
Closes-Bug: #1339613
Do not use mktemp for creating rally.conf

File created by mktemp does not have world readable permissons, but
configuration file should be world-readable.

Change-Id: Ie4b7dbdafe96747c679c6b7fa58cd8af3c92078e
Closes-Bug: #1340670
Add unit tests for benchmark validation

Added following tests for benchmark validation

test_image_invalid_on_flavor
test_image_invalid_on_size
test_image_valid_on_missing_flavor_disk
test_requires_permission
test_tempest_test_no_config_install
test_tempest_set_exists_fail
test_tempest_set_exists
test_required_parameters

Updated return value for mocks in decorator

Change-Id: If9872664aed7a4c77d7dbc3f51f50f739c2e210a
Implements: blueprint improve-unit-test-coverage-rally
Updated mock return values to decorators

Updated the return_value=True/False statements for
mocks to decorators

Change-Id: I4915e11dd4af4776a93d211c4c019213c90c5ff2
Merge "Updated mock return values to decorators"
Merge "Do not use mktemp for creating rally.conf"
Updated test cases in benchmark types

Updated the test cases for increase unit test
coverage

Added following method
test_transform_by_regex_multiple_match
test_transform_by_id_from_base_class

Small nits in types module

Change-Id: Iee29ed36b086c956703a3f146f946a7cb1bfc23e
Implements: blueprint improve-unit-test-coverage-rally
Add rally task detailed info to rally-plot dir

I am already tired rolling to the end of console.log to see the
aggregated infromation, so it makes sense to put this info to separated
txt file in rally-plot dir

Change-Id: Ic492f0acd293fd0a90595658c4da0dea720758ed
Merge "Updated test cases in benchmark types"
Periodic runner refactoring

  'preiodic' runner renamed to rps (runs per second).
  Extensible pool of multiprocessing.Process was implemented instead
  of using constant length multiprocessing.Pool. That should decrease memory
  usage on large iterations and related errors.

Change-Id: I6e367ea30d89d5d0e7ba212ed22e8658421ac9bd