Remove FloatingIPChecker from network_basic_ops

Since wait_for_floatingip()
    a) Fails regardless of FloatingIP association, and functionality
    b) Tests DB integration instead of network performance

It should not fail network scenarios or block them.
Instead, it should be checked in a different, more specific scenario

See bug 1262529 for more details

Change-Id: Ib8a018cce89ff78ac5e967dd5518e65feb9ea0fc
Add tests for volume_metadata

Add tests and tests for volume_metadata.

Change-Id: I37f96ec6d552eed0f5222505a85b90db0dc326b5
port instance_usage_audit_log tests into nova v3 part2

this ports the instance_usage_audit_log tests and corresponding
client into v3. In v3 api, There is no the url:
GET /os-instance-usage-audit-log/:(id).
but the filter:before will be used instead in index action.

Partially implements blueprint nova-v3-api-tests

Change-Id: I726a27bc4f374d3bae98a903196bf2265c31e67c
port admin/test_servers* into Nova V3 tests part2

1. porting admin/test_servers.py and admin/test_servers_negative.py
   into nova v3
2. sync nova v2 changes in Ibd04a1fdaab74fe59bcf16cc99d4ecf4821f4ae2
3. fix a few typos in servers_client.py

Partially implements blueprint nova-v3-api-tests

Change-Id: I319bef11d1aee11ffa892c366cd57eef338b36ee
Closes-Bug: #1259056
Dump all log errors to console

Errors that are not whitelisted are tagged for differentiation.

Change-Id: I1a4f392b3fe4276afbe1610af679d5e11ee8acad
Catch ssh exception and detach in min scenario

The test_minimum_basic test goes through a number of tests however
doesn't do any clean up if a failur occurs.  The master clean-up
routine is ok, but it doesn't account for things like attached volumes.

One issue here is that the ssh_to_server times out do to some other
problem and raises an SSHTimeout exception.  This exception isn't dealt
with, the test dumps out and tries to cleanup by deleting the instance
and the volume, but the volume-delete will fail because it's status is
still in-use.

This exposes another problem, it seems that nova delete will clean up
an instance but fairly regular neglect to detach the volume. This patch
add an addCleanup() call to nova.volume_detach.

Change-Id: I76d19f096d6cb4122eea2e7e5de4eb37b97a4b87
Partial-Bug: #1213215
port nova v2 images related tests into nova v3 part1

This changeset only copies the v2 files into the appropriate v3
directories unchanged. This is being tried in order to make
reviewing of the porting easier as gerrit will display only what
is actually changed for v3 rather than entirely new files.

Partially implements blueprint nova-v3-api-tests

Change-Id: I4355adee713bb217da7f12d4c2fe9b8abf015b05
Add tests for snapshot_metadata

Add tests for snapshot_metadata.

Change-Id: I651200dcdbecf5c4c520e5957ffea3908a4423ef
Skip flavor_access_add/remove related tests

This patch add skip decorator for flavor_access_add/remove related tests.
After use project instead of tenant in the flavor_access extensions, will
fix those tests.

Related patch:
https://review.openstack.org/#/c/58450/

Change-Id: Ibf741059c3a7a94543f1a2230fe7048692e1db0c
Related-Bug: #1265416
Skip simple_tenant_usage related tests

This patch adds skip decorator for simple_tenant_usage related tests.
After use 'project' instead of 'tenant' in simple_tenant_usage v3,
will update those tests.

Related patches:
https://review.openstack.org/#/c/58443/
https://review.openstack.org/#/c/58444/

Change-Id: Ifcb30d1eade2b7a7196c3c0a6b4165e5fdce2944
Related-Bug: #1265416
Fix reference config before initialization in cli tests

In 'setUpClass' method config groups were referenced
before initialization using still empty oslo.config
which is empty if use without other cli test suites.
Fixed.

Change-Id: I4f0109617bf98bbb375cfcf816c074762b9fc69a
Closes-Bug: #1265909
Make run_tests.sh for running unit tests

In other projects the run_tests.sh script is used for project
verification (ie running unit tests) However, because tempest didn't
have unit tests and is itself a test suite the run_tests.sh script was
used to execute the tempest tests. Now that we have unit tests starting
to trickle into tempest the run_tests.sh script can be used for it's
traditional purpose. So, this commit removes the tempest specific
functionality from run_tests.sh and makes it run the unit tests.

Partially implements bp unit-tests

Change-Id: Iac4e9d0908274a20c3d278b2c8d7e00949a1f36e
Add a run_tempest.sh script

This commit adds a run_tempest.sh script which is used for running
tempest in the same manner that used to be handled by run_tests.sh.

Partially implements bp unit-tests

Change-Id: Id03d198b888ebd3673b2ca6fa895164910a42c4c
fix a minor bug when detecting server image flavor

* The function _detect_server_image_flavor has a parameter 'server_id',
* but does not use it (instead, it uses server_id of the class)

Change-Id: I94d46877a67c79035e4ecf3da9abc0156803f2b3
Add extra list server by status test

Add list server by shutoff status test
Add list server by error status test

Change-Id: Ica063797a954a71c0e4c206be08c3c5cf4c60163
Add python-swift client to the requirements

Since Id4b27ee70f420f7536b4c698eb1f3bba15dbd1e8 we have swift scenarios tests
which means that we must include swiftclient as a requirement.
Closes-bug: #1265936

Change-Id: Iee233867446cce098dbce9e5ab9ab1d4b19d97b3
Add base class for Telemetry tests

This patch adds the base class for all Telemetry tests.

Partially implements: blueprint add-basic-ceilometer-tests

Change-Id: If467d05bceb4f5c29a7cac6c83be6fc8aae159c8
Add a unit test coverage tox job

This commit adds a new tox job for running the tempest unit tests with
coverage enabled.

Change-Id: I36b5390ffd241e08e40be2d4b92b9e91a71cdc9e
Add heat stack action test case

Ensure heat action-suspend and action-resume can work
well, so add these cases.

Change-Id: I6ec1b82f1e138ea56d6a8e7cf78d1f9a12a96f2d
add keystone group tests

add two testcases for group and group users:
test_group_create_update_get
test_group_users_add_list_delete

Change-Id: I9fa1821e219c54715f821999dac100daa68283f0