Add swift service to pre-defined service list

* Ignore any service not present in pre-defined service list
  while generating tempest.conf

Change-Id: I69661e0cdafe83b5a3ae5cdb777a5c682117fe18
Closes-Bug: #1400907
Fix html rendering on failed functional tests

Remove -e option from shebang

Change-Id: I32fb1c13e20a61476958eabfca7897caa59dccab
Merge "Add swift service to pre-defined service list"
Python 3 incompatible issue: iteritems

dict.iteritems() was removed in Python 3. This patch
replace dict.iteritems() with six.iteritems() to support
both Python 2 and Python 3

Closes-Bug: #1403071

Change-Id: I5bcee5db2d7188633d45e6161e0c956449ad2197
Converting scenario context to dict

This changes scenario context that is function to
a simple dict.

Change-Id: Icd2889434179ba08b8237b6c32d9ee6939dbf00a
Fix cli tests vs MOS clouds

MOS clouds have "TestVM" image and "novanetwork" network by default.

Change-Id: Ia382734af7b613608a901c21a85136c9e491589f
Updates in Context order

Small change that fixes cleanup order, and a bit of refactoring.

Changes:
  * order values in rally.benchmark.context.cleanup.context
    set to maximum value, so this cleanup runs first after scenario
    is finished. That avoids blocking of context resources deletion
    by resources that created by scenarios.
  * change some resources order so they are not immediately follows
    after each other: 301, 302, 303 -> 310, 320, 330.

Change-Id: Id195d7df6cb369d448f8a0019891a693a0d3d0aa
Remove SLA checks for NovaServers.boot_server_from_volume_and_delete

This benchmark is super unstable and almost fully block rally gate.
The reason is in Nova and Neutron races. So we have to remove until
we fix those projects.

Change-Id: I2188b984183578c5c3f1f42b5e1ba5593692683f
Merge "Python 3 incompatible issue: iteritems"
Merge "Remove SLA checks for NovaServers.boot_server_from_volume_and_delete"
Add list_servers scenario for Nova

Current Rally provides "boot_and_list_server" scenario, but doesn't provide
"list_servers" scenario. User can specify number of servers which will be
created in context.

Change-Id: I1a4f0b30dcfba08f8830448c99e687014282e094
Merge "Updates in Context order"
Merge "Converting scenario context to dict"
Add Network Context Class

Context for networking resources.

Note:
  using this context in security_groups related scenarios
  will be added in another patch.

Main changes:
  * the network context class
  * rally.benchmark.utils.RAMInt class that represents integer value in RAM,
    so we can make process safe sync of cluster-unique stuff (like CIDRs)
  * rally.benchmark.wrappers.network module, that unifies network service
    implementation, for usage both in context and scenarios
  * optimization in NovaScenario._boot_server

Co-Authored-By: Lingxian Kong <anlin.kong@gmail.com>
Co-Authored-By: Timur Nurlygayanov <tnurlygayanov@mirantis.com>
Co-Authored-By: Sergey Skripnick <sskripnick@mirantis.com>
Co-Authored-By: Vadim Rovachev <vrovachev@mirantis.com>
Co-Authored-By: Aleksandr Maretskiy <amaretskiy@mirantis.com>

Implements: blueprint benchmark-context-network
Change-Id: Ia2c461ba3421dc9650c4bb7949c115fee08c6b7b
Use Network Context in security groups scenario

This patch replaces code that creates networking resources in
NovaSecGroup.boot_and_delete_server_with_secgroups
with usage of our new Network Context.

Change-Id: I9e63256d409978763ee3bb9bf0d896313ba6dec9
Merge "Add list_servers scenario for Nova"
Merge "Add Network Context Class"
Sahara auto_security_group parameter added

The auto_security_group is now enabled by default for all Node Groups in all
Clusters. This is required for setting up a security group with a list
of TCP port for Hadoop operations.

Sahara does both creating and removig security groups automatically.

Change-Id: Ie862b541f468286bf4380f6e8d19014229beef91
Merge "Use Network Context in security groups scenario"
Adding iteritems validation

Since in Python 3 there's no longer dict.iteritems()
and to keep the compatibility with Python 2, instead of call
dict.iteritems(), we must call six.iteritems(dict).
This patch is to avoid broken this compatibility in the future
adding a validation for iteritems.

Change-Id: I7c5e312801db886483b0ff5c45a80cba6848c95e