port test_hypervisor into nova v3 part1

This changeset only copies the v2 files into the appropriate v3
directories unchanged. This is being tried in order to make
reviewing of the porting easier as gerrit will display only what
is actually changed for v3 rather than entirely new files.

Partially implements blueprint nova-v3-api-tests

Change-Id: Iceb6bbde5901325cc5948f61b9b765f635434629
Update openstack/common/lockutils

The following commits are in this update:

79e6bc6 fix lockutils.lock() to make it thread-safe
ace5120 Add main() to lockutils that creates temp dir for locks
537d8e2 Allow lockutils to get lock_path conf from envvar
371fa42 Move LockFixture into a fixtures module
d498c42 Fix to properly log when we release a semaphore

Change-Id: Iefe5f90b3886c58736bdb27e9019bc19a8e49179
add some negative tests for security group:

- test_create_default_security_group
- test_create_sg_rules_with_non_existent_sg

Change-Id: Ica468bc0c41845050505a636a2add47b586fcac3
Add test for Swift formpost middleware

Change-Id: Ifb86572d5c050b3e01553160f1774de62fb525bd
Add migrate negative tests

- test_migrate_non_existent_server
- test_migrate_server_invalid_state

Change-Id: I41035371c38dfb1ab52db39d3b8893aa29b79f15
port servers_negative tests into v3 part1

Partially implements blueprint nova-v3-api-tests

Change-Id: If6ebd818904ef57d1c5a144f179a958b617df7e1
Check HTTP response headers of Swift API in detail

All HTTP response headers for each Swift API are checked their existence
and style. For checking, create custom_matchers.py file in common directory
and implement specific matchers so that they can be reused.

Change-Id: I7dcd87c814cf657999796bda75482505112b4edb
Closes-Bug: #1240856
Adds delete api test to glance

This change adds api test for v2/images/​{image_id}
also moves to negative tests in test_images to test_images_negative
​

Change-Id: Id231ff3325a6a9a1a3eab67fafb2658832170f0c
Improve the UX around sample config generation

This commit just adds some documentation around using the sample config
generator. It also adds a wrapper script that sets the env variable for
running the oslo generator script with tempest.

Change-Id: I860b17defeeb85174e68b1e8b046b0e43c30683b
Enable a uuid flavor

Current tempest configuration enforces a flavor id should be integer,
but we can create a uuid flavor. For example, the following command
creates a flavor with auto-generated uuid:

  $ nova flavor-create m3.small auto 512 0 1

This patch enables a uuid flavor by changing a flavor_id type from
integer to string.

Change-Id: I6567ef3086710508ef4215e93634601119ce3402
port attach_interfaces and server_address tests into v3 part2

This port interface client into v3 and the attach_interface tests
into v3, also port server_address tests into v3

Partially implements blueprint nova-v3-api-tests

Change-Id: I0701ace05c6ae7feb72a6a00949ae830f63ff853
port test_simple_tenant_usage into nova v3 part1

This changeset only copies the v2 files into the appropriate v3
directories unchanged. This is being tried in order to make
reviewing of the porting easier as gerrit will display only what
is actually changed for v3 rather than entirely new files.

Partially implements blueprint nova-v3-api-tests

Change-Id: I0ef1d85fe7ce7e9ca836c6e3a5a447df9941eccd
Ensure no dangling resources are left if tests are skipped

When tenant isolation is enabled, some network resources are
provisioned even though some tests are skipped. This has
a bad effect because these resources (like ip allocations,
routers and such) may have quota's default values that are
low.

With this change we ensure resources are torn down correctly.

Closes-bug:  1254166
Related-bug: 1232971
Related-bug: 1253966

Change-Id: Id86841775a26f12a5ae8c520a086e5f1ebd63135
Add test_cases for cinder cli in v2 version

Add a new test_class for cinder-cli tempest in v2 version.

 + test_cinder_volumes_list_in_v2
 + test_cinder_absolute_limit_list_in_v2
 + test_cinder_backup_list_in_v2
 + test_cinder_extra_specs_list_in_v2
 + test_cinder_quota_class_show_in_v2
 + test_cinder_quota_defaults_in_v2
 + test_cinder_quota_show_in_v2
 + test_cinder_rate_limits_in_v2
 + test_cinder_snapshot_list_in_v2
 + test_cinder_type_list_in_v2
 + test_cinder_availability_zone_list_in_v2
 + test_cinder_service_list_in_v2
 + test_cinder_transfer_list_in_v2
 + test_cinder_bash_completion_in_v2

Three command-representations are different between v1 and v2:

 = cinder list
 = cinder snapshot-list
 = cinder bash-completion

Change-Id: Ia57af3cf3d8a0e62063ade1542c086e26f041e1e
Add some tests for os_update_readonly_flag

There is no test for os_update_readonly_flag api,
so add some for it.

Change-Id: Ice9a6ffea47dbaa492067f746edddcfbfc4eac4a
Merge "Improve the UX around sample config generation"
Add two more tests for Swift staticweb middleware

Enhance the existing test to check the following functions:

web-listings-css: Custom CSS for file listing
web-error: Custom error page

Change-Id: Ib41d9593d1d3725336caf8ced62bde6d206174b5
Implements: blueprint test-swift-staticweb-middelware
Use channel_timeout for SSH connection timeout

Occasionally, SSH will get wedged so that a connection attempt is stuck
forever. When this happens, we need Tempest to abort the attempt and try
again. Currently, the individual connection timeout is set to the
overall timeout, so there will only ever be one attempt if this happens.
Using the channel_timeout instead will ensure that multiple connection
attempts are made even when the connection is wedged.

Fixes bug 1236524

Change-Id: Ie8dff41780bbf004cff5c880db202a8ae23a85c1
Add missing "interface" argument to AltManager

AltManager should have an interface keyword argument in the
initializer and also pass it to the super class.

Change-Id: I0d66609a7649d339f09b5948da5178df15ea43b2
Closes-Bug: #1255559
Dump all error messages for neutron

Also, prepare to fail all jobs except neutron if there are errors.

Change-Id: I6e8299b45a8845d9772f37feaf360b9bc1be2675