Add list server filter with extra limits

Add list servers filter with zero and exceeding limits

Change-Id: I81bfd831025af1ad42e26ef8a25985c06120aaf7
Refactor usage of custom_match tests

For some requests a check outside of custom_match was used, thus
bug #1262534 was not completely closed.

This patch refactors part of the code to use custom_match
as far as possible and also adds some more checks.

Closes-Bug: #1262534
Change-Id: Ic0760d6d91a83bdce45ae42dd3f9d05a7bc8b6b3
Moves negative tests from test_server_metadata

This change set moves the negative tests in
tempest/api/compute/servers/test_server_metadata to
a new file test_server_metadata_negative

Also removes usage of modules directly and qualifies
test_server_create_metadata_key_too_long as negative test.
 ** seprates test into individuals
Note: HACKING.rst
The second requirement is that all negative tests must be added to a negative
test file. If such a file doesn't exist for the particular resource being
tested a new test file should be added

Change-Id: I91f1ee898866e458ff15a4d5035a772ff5c14701
Add a check for compute api versions to verify_tempest_config

This commit adds another verification method to the
verify_tempest_config script that adds a check to see if the compute
v3 api is enabled.

Partially implements bp config-verification

Change-Id: Idae7db73c9eba94b7f74ec2f71e20d4267aa582c
Fix parameter type spelling tempest HOT template

HOT template file heat_minimal_hot.yaml uses uppercase spelling
for parameters, where HOT should use lowercase (e.g. string instead
of String).
While code has has been toloerant so far, the following change for
parameter schema validation refactoring make checking more strict
and causes tempest to fail:

https://review.openstack.org/67183

This patch fixes parameter type spelling in the tempest HOT
template.

Change-Id: I52a1b2272cd299cce3259805ee240a5782772aa4
Closes-Bug: #1270833
Fixing typo in test_volumes_get.py

The word verification is mispelt in test_volumes_get.py.

Change-Id: I0d7891a5574aa9503f0d5765210a8285c331ffe7
Add a couple log errors to whitelist.yaml

These log errors have hit the large ops jobs several times. There is one
in ceilometer acentral and one in nova conductor.

Change-Id: Idc30110085e95c615958fc5f90e86417855e6d7a
Avoid expiration before updating metadata

The X-Delete-At value might already be in the past after the initial
object creation because the current time is used to set the
X-Delete-At value. Creating the initial object before starting each
test prevents this.

Change-Id: Id892e802601b50d4eeadbf5b857212adef591456
Closes-Bug: #1269597
Rewrite RemoteClient.get_boot_time()

This is doing conversion between time formats, while we could really
just stay in seconds. This also fixes the method to work for cirros,
which doesn't know about human readable time formats.

Change-Id: Id123d71adb29d169a26f0dde6af00f292fe61d09
Closes-Bug: #1244823
Sync Patch and PatchObject fixtures from oslo-incubator

This change allow us to set a replacement function to these fixtures.
Depends on I32a90b4d47174b6adb53b525a4add7002411b29d

Change-Id: I897db568280c026f92f7f6da8c1ea974274fc037
Fix parameter in auth error message

Using Idenitity V3 auth method the AuthenticationFailure exception waits for
the project name parameter to show it's message correctly.

Change-Id: I1458f6c20cf65057663ecbf52a931c288fd4275c
Make --debug flag on run_tests and run_tempest use testtools.run

This commit changes the --debug flag on run_tests.sh and run_tempest.sh
so that instead of setting set +o xtrace will run tests with testools.run.
This enables pdb to work because calling subunit.run or using testr will
interfere with pdb.

Change-Id: I9953af7a2375a1d26df69559799be3df973756af
Use automated create and update methods for core network resources

The patch makes use of automatic create and update methods for
networks, subnets, ports. Bulk create method was moved to base client
to get rid of code duplication in json and xml versions.

Change-Id: I0e1295d6c195187d36b3b811a0dd28c5477cd07b
Add simple node group tmpl API test for Savanna

It tests CRUD and list operations for node group templates.

Change-Id: Ib2c94db50db03998ad402d52b4f87032581fdc76
Check if service is available for cli tests

This commit adds checks to the CLI tests to see whether the service
that is being tested is available or not. Previously the tests would
run regardless of whether the service was listed as available in the
config file or not.

Change-Id: I16e0bbab85d2234d671ea2577757b38480e66d69
Fix class inheritance for volume_types tests

Previously the tests in test_volume_types.py manually setup an
admin_client using the admin credentials specified in the config file.
However, this is not correct because with tenant isolation those
credentials shouldn't be used other then to create a new tenant.
Additionally, everything performed in the test class's setUpClass was
already done in the base class. This commit corrects this by
changing the test class inheritance to the proper base class.

Closes-Bug: #1271312

Change-Id: Ia798c2c41d132a2ed17d6e0a9215d21a00c97a32
Add test for volume list with all-tenants

Add test for volume list with all-tenants param

Change-Id: Idc605ce5036090fe086164cdc24d8fe36b09f866
stop validating user IDs on role assignment operations

Keystone is proposing to change it's behavior regarding user & group ID
validation on role assignment operations in order to establish full
isolation between the assignment and identity interfaces, which were
split apart during havana.

Change-Id: Id0549d6b26f348f6029c238adfcb4d8dc47be316
Implements: bp no-check-id
Skip test_list_servers_by_admin_with_all_tenants test

This patch add skip decorator for test_list_servers_by_admin_with_all_tenants.
After use 'all_projects' instead of 'all_tenants', will fix this test.

Related Patch: https://review.openstack.org/#/c/58292/

Change-Id: Ibb71c3a966f6c09b93e821781d4266d56d65950b
Related-Bug: #1265416
Increase ping timeout from 60 to 120 seconds

The Cirros image only sends out three DHCPDISCOVERs with 60 second
waits between. The ovs_neutron_agent may not have the port wired in
time for the first one, and with ping_timeout=60 the test will be
terminated before the second one is sent. This patch increases the
timeout to 120 seconds to prevent that.

Change-Id: I03fcec50b91fd89ad64e16fce82f9211c2e086a1
Partial-Bug: 1253896