Make output from check_logs less verbose

This commit changes the output of check_logs.py to be a bit more
concise and clear. Instead of printing out every instance of errors
found in the log files it will only print out which individual files
had errors. If a file is marked as not allowing ERRORS or TRACES it
also prints that along with the filename. This should hopefully avoid
confusion around the operation of this script running in the gate.

Change-Id: Ib2a9a9736470cd3b445fb51a95a1a6c6696bb2cc
Fix unstable assertion in test_cinder_endpoints

In simple_read_only.test_cinder.test_cinder_endpoints, the test case
assumes that the first table of 'cinder endpoints' always ['nova',
'Value']. However, it is sometimes wrong.
So in this commit, the test verifies that they have 2 or more headers
and has a 'Value' header.

Change-Id: Idb3f2ebc6b7e05178621ac3701b7c3d02e1d7591
Closes-Bug: #1363018
Closes-Bug: #1362703
Add a test for deleting multiple objects by POST method

From swift Icehouse version, bulk deletion supports POST method as well as
DELETE.

Extra fixes:
 - Bulk is an optional function with WSGI middleware, therefore each test
   is annotated with @test.requires_ext
 - Refactor test_account_bulk.py by separating common codes to one method
 - Simplify delete_account method of the Swift's account service client

Partially implements blueprint add-icehouse-swift-tests

Change-Id: I3b63bc730f993cdb626c5a77c18ae917d98e911b
Support lack of ephemeral volumes for baremetal

The agent driver in Ironic does not yet support ephemeral volumes.
This change allows tempest to test Ironic with the agent driver
by skipping ephemeral volume checks if the ephemeral volume size
is 0.

Change-Id: I9525d1c75007555d368a2aa66ab840f41b584a30
Backward compatibility to credentials in conf

Before switching to the YAML based configuration as the default for
credentials, we need to introduce backward compatibility to allow
credentials to be configured in tempest.conf.

Partially implements bp:test-accounts

Change-Id: I29c66c87d02f442b1d5b0b2d7c82ff2a140c111f
Unskip test_create_and_get_delete_bucket()

test_create_and_get_delete_bucket() was skipped because of bug 1076965
which is now in a state which should allow us to unskip it.

Change-Id: I56bc2bfb5a3019cf4a2979b40c7d7cbe3c8cf71a
Related-Bug: #1076965
Unskip test_rescope_token()

test_rescope_token() was skipped  because of bug 1351026 which is now
in a state which should allow us to unskip it.

Change-Id: Ia0fd713fea041c24f4ff1f041a48d9bac7fef6e7
Related-Bug: #1351026
Unskip test_update_port_with_second_ip()

test_update_port_with_second_ip() was skipped because of bug 1364166
which is now in a state which should allow us to unskip it.

Change-Id: I263bd4ef45ea02b18c6d00b6e27f0b12442be9ee
Related-Bug: #1364166
Remove PYTHONHASHSEED=0 from tox.ini

We've ironed out remaining issues that crop up when running
with a random seed. This updates tox.ini to revert to the default
behavior of running with PYTHONHASHSEED=random.  The pep8 check
continues to run with PYTHONHASHSEED=0 to workaround oslo issues
around config value ordering in the check_uptodate.sh test.

Change-Id: Ifa0dba8c3970fc676d374f33c129ef0f9d526c94
Migrate test_server_cfn_init to tempest clients

Migrate the test and change OrchestrationScenarioTest used by the test.
This is a part of the migrating all scenario tests to using tempest own
clients.

Change-Id: Iafc1b021fe8a9a5daa0e2d7eef0542b7929c415a
Partially-implements: bp:tempest-client-scenarios
Add response schema for V2 sec grp default rule

This patch adds response schema for nova V2
'os-security-group-default-rules' APIs.

Response body of create/show 'os-security-group-default-rules' -
{
    "security_group_default_rule": {
        "from_port": 80,
        "id": 1,
        "ip_protocol": "TCP",
        "ip_range":{
            "cidr": "10.10.10.0/24"
        },
        "to_port": 80
    }
}

Response body of list 'os-security-group-default-rules' -
{
    "security_group_default_rules": [
        {
            "from_port": 80,
            "id": 1,
            "ip_protocol": "TCP",
            "ip_range": {
                "cidr": "10.10.10.0/24"
            },
            "to_port": 80
        }
    ]
}

Delete API only returns 204 status code.

Change-Id: Id24857ee95445570d45aac3e1a25e607d8df78d1
Fix scenarios not passing down specific network

Nova v2 api expects nics in specific networks to be passed
down in an array of "networks". nics is used in novaclient
but converted to networks in
python-novaclient/tree/novaclient/v1_1/servers.py#n520

Apply the conversion to the parameters to make the check
pass in case where there would be multiple networks
matching the requirements. Also remove a case where scenario
manager forced in the wrong network into the tests.

Closes-Bug: #1368834
Change-Id: Ic0b87377c5878e240a0fbcc6549023c828dd97ab
Select AuthProvider type from credentials type

auth_version is used to get defaul credentials as well as to
select the AuthProvider class. If credentials of an API version
different from the configured one are used, a mismatch happens.

Instantiating the AuthProvider class that corresponds to the
version of API represented by the credentials object.

Closes-Bug: #1369557

Change-Id: I1ed6da90ce0abed805cf39190cb1ac3baa3f63b6
Merge "Support lack of ephemeral volumes for baremetal"
Removes bogus negative create image compute

Removes test_create_image_specify_multibyte_character_image_name
as it is not a valid test. It currently does not send an
invalid utf-8 sequence, but a valid unicode one. Also we can't actually
send an invalid utf-8 sequence via JSON as it is not possible to
encode an invalid UTF-8 sequence into a series of unicode characters
which is what JSON uses as strings. So its not possible for it
to fail this way. And we don't do XML testing for this type of test.

Change-Id: I39b5c017c8a173f8dd56a14c1bc7dc6952ac787d
Partially-Closes: 1006725
Merge "Select AuthProvider type from credentials type"
Migrate TestStampPattern to tempest client

Migrate TestStampPattern to tempest client. The test is currently
disabled in the gate, so this will be tested by adding a temp
patch on top removing the skip.

Partially-implements: bp:tempest-client-scenarios

Change-Id: I42524372ae64121f2e3b58f37b960f8d1bbc8b6a
Merge "Unskip test_rescope_token()"
Framework for resource safe class level fixtures

Modify BaseTestCase, add resource_setup and resource_cleanup
methods, invoked by setUpClass and tearDownClass respectively.

Partially-implements bp:resource-cleanup

Change-Id: I5f025b4f76d6d85fbefbada9475daf784425037a
Migrate computev2 API tests to resource_* fixtures

Partially-implements bp:resource-cleanup

Change-Id: I59eb2d9789368c812282ce12ae7e571be720badb