Add CONFIG_SCHEMA to virsh provider

Also added tests VirshProviderTestCase.test_invalid_config and
VirshProviderTestCase.test_invalid_connection.

Change-Id: Iee3ab8de5c7d95b8e2ccbe786b4a64f135a09012
Related: blueprint common-config-validation
Implement periodic execution of benchmark scenarios

Being able to run benchmark scenarios not continuously but periodically,
setting the interval between two consecutive benchmark scenario launches,
is a crucial part of making Rally closer to real-world cloud usage scenarios.

Here we add such a capability by adding a new execution type, namely
"periodic". We also add new scenario config parameter "interval" which
enables the user to set the interval between two consecutive scenario
launches in minutes.

A sample benchmark config for periodical booting/deleting 5 servers, one
server every 2 minutes, now would look like this:

"benchmark": {
    "NovaServers.boot_and_delete_server": [
        {"args": {"flavor_id": 1,
                  "image_id": "73257560-c59b-4275-a1ec-ab140e5b9979"},
         "execution": "periodic",
         "config": {"times": 5, "period": 2,
                    "tenants": 3, "users_per_tenant": 2}}
    ]
}

Blueprint flexible-benchmark-config

Change-Id: I21a0a89f60bd5aaf9b3f419f72cdec7842bc7c38
Merge "Implement periodic execution of benchmark scenarios"
Add ability to get stdout/stderr to sshutils

Added new method `execute_generator` which yields stdout/stderr
data by chunks. Added new arguments `get_stdout` and `get_stderr`
to `execute` method. Now it returns tuple with stdout/stderr strings.

Change-Id: I4b6cf4764981c611679fb90505df8ec197224526
Merge "Add CONFIG_SCHEMA to virsh provider"
Add start and finish time of the deployment

Appropriate fields added to deployment model, and two methods:
set_started and set_completed.

Change-Id: Ib8b8b8e8b7eb0dbf2b288ffb452be978ea8728ec
Merge "Add start and finish time of the deployment"
Fix too slow .VirshProviderTestCase.test_create_vm

We should mock time.sleep() method.

Change-Id: I2b919f7e70e866209612efd0bf31e4b9a5c4180b
Closes-Bug: #1259248
Update oslo code

Just update to the last version oslo code

Change-Id: I51519dadef383ea73b462760fdf4de62678596b9
Rename "create_vms" to "create_servers"

Change-Id: Icc62ab1316ab3d920bd3a066f51b3f55c2d16e58
Related: blueprint provider-server-refactoring
Get rid of fuel-ostf-tests

As this verification doesn't work
+ I didn't like this approach from start.

I am really happy to remove this sh** from Rally code.

Soon we will use tempest to verify that cloud work.

bp remove-fuel-ostf-tests

Change-Id: If941d37fd128a4e86032cf2f973b3b67a29dd638
Add .venv to git ignore

.venv is used by run_test.sh so we don't need it in git at all

Change-Id: I53aecedf31d6092782d73ef7e3da756ecb892161
Remove unused sh requirments

We should try to keep requirments as small as possible

Change-Id: I50ed806df021a747eed869d16393bef3898f8d26
Merge "Rename "create_vms" to "create_servers""
Merge "Add .venv to git ignore"
Rename "destroy_vms" to "destroy_servers"

Change-Id: I2937710c8a255ecfdf2edc0da68f6df1c5e580a3
Related: blueprint provider-server-refactoring
Prepare instances for SSH access

This patchset is in preparation for a scenario for running a
test/benchmark within an instance.

Change-Id: I94276237fb5b453b194e58ed00df589a3420a6ed
Benchmark scenarios for Rally: run task in instance

This patch allows a user to define a scenario where Nova instances are
created, then a script which outputs arbitrary JSON is run, and then the
instance is destroyed.

This allows tests/benchmarks from the instance perspective, as well as
from OS APIs.

blueprint benchmark-scenarios

Change-Id: I4b1f77f5f8c55fe1da41b6ab0b23eb03303ba95f