Add boto tests for idempotent RunInstances calls

The EC2 API supports providing a unique client token to
the RunInstances call to ensure idempotency. In other words,
multiple RunInstances call with the same client token will
not start up multiple instances.

This adds a test for this condition, including ensuring that
a new instance is spawned when a client token is re-used
after the original instance linked to it has been terminated.

Fixes bug #1202404

Change-Id: Ia11eb9ac082a623a1ad03b89fb6dbf7cad9f9c99
Ignore the default quota values

The default Quota values are just values from config file,
and they are usually different at ever cloud provider.

In the API compatibility perspective the values are not
important, but the keys presence is important.

The other option would be, adding the expected response to the
tempest config.

The test_get_updated_quotas test case also got a dedicated tenant.

Fixing bug 1130461
Change-Id: I50204dc7955d68491ad63f239c42fb47591a0be7
Add tenant isolation for glance api tests

This commit adds isolated tenant support to the glance api tests. The
glance base test class is modified to call _get_isolated_creds() from
BaseTestCase if the isolated tenant config flag is set.

Change-Id: Ia22bd66006c010dcc4b57a6a6346b281086003d9
Simplify whitebox/manager

* Allow the generic resource deletion (thing.delete) to
operate on resources allocated in the setUpClass-es too.

* test_images_whitebox.py is using the python
  client libraries as the scenario tests.

* Remove the not used part of the tempest/manager.py

Change-Id: I980a70d22dc7a3a65a26a8197c7888b125eb3b05
Unskip test_register_get_deregister_ari_image

The test case skiped because of invalid state transitions and because of
wrong relative path handling, both issue has been fixed.
rong relative path handling, both issue has been fixed.

Change-Id: Ie8b4cb4ee69fb6765351cee9414d599cbae63db8
Add Neutron CLI tests to tempest

Basic, read-only tests for Neutron CLI client.
Checks return values and output of read-only commands.

Change-Id: I5384e063686d21f006f8837cd916177e3d490bd6
Add posargs to testr-full tox job

This commit adds posargs to to the testr-full tox job. This enables
passing extra arguments to testr when running the tox job.

Change-Id: I349e1aa21ce4e5e93ffd7e2c9667f2cbbec2a413
fix race condition in service list compares

there is a small chance that between the 2 service queries that
the service list is updated by the periodic job. We'll assume
stability of the service host list in the regular case, but
the other metadata is changeable, so only compary the binary
lists.

Fixes bug #1205450

Change-Id: I29f687d4279b79f192de3bae3d15abebd3d858a1
skip stamp test until race in nova can be debugged

This test is causing a lot of gate resets, and as far as I can
tell they are really nova races in volume attachments. However
we should skip the test for now until these can be sorted out.

Related to bug #1205344

Change-Id: I983779841ac3d3f79442e96b37a0cc8da85ae55b
Allow to run swift and keystone api tests standalone

Protect glance init using the config settings.

Change-Id: If8196dbbccd8dbb1ec9f8075d978608e7f709e99
Fixes: bug 1205923
Revert "Add jsonschema to requirements.txt"

This reverts commit d35a64499673c2d765dd342fa21dabdbfa4ba276.

Which is possibly the cause of grenade failing the gate, we'll
bring this back later if it isn't.

Change-Id: I00815f7ef053ae4d5da71fa31885a52ae887c6fc
Merge "skip stamp test until race in nova can be debugged"
Negative attribute added in volume negative test

Here a neagtive attribute is added in
the decorators in the neagtive tests.

Change-Id: I31b6e229a62ffdee61a40a69d406d330260b3fea
Merge "Add posargs to testr-full tox job"
Use assertIn and assertNotIn instead of assertTrue/assertFalse

The assertIn and assertNotIn is defined in testtools, it is expected to
work with all testtools supported python version.

The assertIn and assertNotIn is more verbose when a real issue occurs.

Change-Id: I7a21a6e38f606deb58b5bade6414f6c4a4142f4b
Handle a possible volume attachment visibility wait/race issue

The attached volume does not became necessarily immediately
visible on the guest even if the volume is in the 'in-use' state.
We may need to wait until it appears in the /proc/partitions
before any other action.

This patch also increase log verbosity, you will be able to see
 the actually visible partitions on the guest system.

Change-Id: I2b2d908b791d07066e5357ec0d213b953d5ce204
Merge "fix race condition in service list compares"
Merge "Use assertIn and assertNotIn instead of assertTrue/assertFalse"
Merge "Add Neutron CLI tests to tempest"
Merge "Unskip test_register_get_deregister_ari_image"