Dump all log errors to console

Errors that are not whitelisted are tagged for differentiation.

Change-Id: I1a4f392b3fe4276afbe1610af679d5e11ee8acad
Adds test_show_XX_fields cases to show some fields

This patch modifies the _show method to make it accept field_list.
It adds the cases to show some fields for network/subnet/port.
A related url example is
/v2.0/networks/103d47a3-XXXX-018c095ab35d?fields=id&fields=name

Change-Id: If2b9edd67ad0c43679332ec28ca80940c0c67d9e
Return body output after given status reached

This change allows stack output to be parsed/checked.

Partial-Bug: #1269566
Partial blueprint: tempest-heat-integration

Change-Id: Iff23620dbce2c834591836dfed8b68439a9804cf
Add missing isolated_cred cleanup to savanna tests

This commit adds a missing call to the tearDownClass in the base savanna
test class. Without this call every time the savanna tests run with
tenant isolation enabled the resources created will never be cleaned up.

Closes-Bug: #1275003

Change-Id: I69bafb5a9149f7c49390fc33f27629a8caeb5f9f
Add test for OS::Neutron::Router Heat resource

Added a test that checks that a OS::Neutron::Router is created
correctly.
Replaced all OS::Quantum with OS::Neutron.
Replaced all Ref with get_param or get_resource.
Lower case instead of Upper case when applies.

Change-Id: I9f4828eee8517422847c05fbb45530699abe8e96
Partial-Bug: #1269569
Add skips to the services decorators

This commit adds a skip to the services decorators. Previously the
decorator was used solely to add an attr to the test_id that specified
which services the test exercised. However, this attr also specifies
which services need to be enabled to run the test. So if a service tag
is set then the decorator will raise a skip exception if the services
specified are not enabled.

Change-Id: Ie5b4f7b7c068b37832e97ffc2a3972b6358425ac
Change import of exceptions for keystoneclient

Keystoneclients uses module `keystoneclient.exceptions` for storing
exceptions, so it needed to import `keystoneclient.exceptions`
instead of `keystoneclient.apiclient.exceptions` in tempest.

Change-Id: I68cb50bd092e9cc304710bf7748a1c0de5554612
Closes-Bug: #1276093
make testing neutron api extensions optional

When the Neutron API extension that test case needs is unsupported
by Neutron plugin running, the test case will be skipped.

Change-Id: Ie3b0f94ea084076ccc10d6a141c9120bf9900395
Closes-Bug: #1270244
Add unit tests for negative test framework

Add basic test cases for generate_json and negative auto test.

Partially-implements: bp negative-tests
Change-Id: I52d376689c0eca0e732ec8a506039b4ef0e326fe
Add the keyword "Test" to some test class names

Most test class names contain "Test" and that shows their meanings
clearly. This patch adds the keyword to some test classes which do
not contain it.

Change-Id: I3d3e4034cd5f26fbb8f92566ad5eac1acff6fd14
Add check_uptodate.sh to run_tests.sh -p

Now, check_uptodate.sh is executed by 'tox -epep8' or using it directly.
We have run_tests.sh for convenience and many developers use it for
checking their code. So we should also have 'check_uptodate.sh' in
run_tests.sh.
This commit adds check_uptodate.sh to 'run_tests.sh -p'

Change-Id: I4c994e0589cfd6cb213aed5acd232670fc320a26
Multiversion authentication part2

Address last comments from part1:
- replace auth_data[0] with get_token()
- add token property to rest_client
- Remove comment about planned changes from config.py

Partially implements: bp multi-keystone-api-version-tests

Change-Id: Ia54cd3d824e44dd99d9226d4c0c6d6861d8c12ae
Fix admin tenant credential

Change-Id: Ie23fc998954a831312d21ca91a315e39c5fd34c2
Savanna: add API client and tests for plugins

Change-Id: I1af1a3e6dbaeec2e1c7a1b9db9fc009822196f9b
Negative tests: Add result check for resources

This add an result check if a invalid resource is given. Introducing a
new dict that can be enhanced later for other cases.

Change-Id: Ief3e51fafb9437a8e6b9a71aad79459716bac3d4
Partially-implements: bp negative-tests
Make v2 and v3 identity apis configurable

This commit adds a config option to the identity feature enabled group
to specify whether the v2 and/or v3 apis are enabled in keystone. In
the process of adding this feature the logical split between v2 and v3
tests in the identity api tests is made more clear. Additionally as part,
of the split several bugs are fixed where the v2 api was being called
in the v3 tests.

Change-Id: I0d727f3567c82fe512b956110bb813119ced0b3d
Fixed misspellings in Tempest

Change-Id: Id52898cb47008677640e228363dde96e9cba173b
network: add metering api operations

This patch aims to bring new tests related to Neutron Metering plugin.

They cover:
- List / Create / Show / Delete metering labels
- List / Create / Show / Delete metering label rules

Note: Update operation is not covered by the API.
Also add basic operations in network admin client.

Change-Id: Ieaf9a5dcd52f54e015e7565f50a3ea81569c483a
Signed-off-by: Emilien Macchi <emilien.macchi@enovance.com>
Support building wheels (PEP-427)

Universal is used to identify pure-Python module(by bdist_wheel). For
these, it is sufficient to build a wheel with _any_ Python ABI version
and publish that to PyPI (by whatever means).

Change-Id: Ib15e61ce3edf6f2694795167c85d40457bf11292
Test to list ports filtered by router ID

Added a test case 'test_port_list_filter_by_router_id'to test_networks.py
in 'tempest/api/network'. This test case adds an interface to router using
port ID and checks if 'list_ports filtered by router id' returns only one
port that was added while creating interface

Change-Id: I1d33614a277ff6767cbb4619de0ebef43b4980b1