Fix arguments for method expected_success

In expected_success method we expect to get status code of
API response, but we use incorrect argument 'resp' instead
of 'resp.status' in several files.

Change-Id: I28f9e4862ddd42322757f5b206ddfb6ddabcfe0f
Closes-Bug: #1354389
Do not run fwaas API tests in smoke

Now that we are running full tempest against neutron, and because fwaas
is not part of core functionality (and not fully baked). Remove these
test from smoke as part of the effort to only test advanced services
against neutron and not against all projects.

Related patch: Ib315d30ff3c4463203f7ebe00e159a9680cf1616

Change-Id: I2e0ce9641becabbeed5f6ad82ad478d84a37f36f
Work toward Python 3.4 support and testing

Change-Id: If36e1a5e51cf63e499acb374d4aeace608c13512
Make output from check_logs less verbose

This commit changes the output of check_logs.py to be a bit more
concise and clear. Instead of printing out every instance of errors
found in the log files it will only print out which individual files
had errors. If a file is marked as not allowing ERRORS or TRACES it
also prints that along with the filename. This should hopefully avoid
confusion around the operation of this script running in the gate.

Change-Id: Ib2a9a9736470cd3b445fb51a95a1a6c6696bb2cc
Fix unstable assertion in test_cinder_endpoints

In simple_read_only.test_cinder.test_cinder_endpoints, the test case
assumes that the first table of 'cinder endpoints' always ['nova',
'Value']. However, it is sometimes wrong.
So in this commit, the test verifies that they have 2 or more headers
and has a 'Value' header.

Change-Id: Idb3f2ebc6b7e05178621ac3701b7c3d02e1d7591
Closes-Bug: #1363018
Closes-Bug: #1362703
Fwaas API Test Enhancement

Add Test to insert and remove firewall rule to firewall policy

-Create a firewall rule
-Create a firewall policy
-Insert a firewall rule to policy
-Validate the insertion of rule to policy
-Remove the firewall rule from policy
-Validate the removal of firewall rule from policy

Change-Id: I3c9711294e1e6323bdad4ff783de1ed19e133c1b
Migrate test_encrypted_cinder_volumes to tempest client

Migrate the test parent class of EncryptionScenarioTest from
OfficialClientTest to ScenarioTest. And some helper functions are
migrated to ScenarioTest.

Change-Id: I33bcd8d0d787ce67617e6ef07652fe1ca1b7e111
Partially-implements: bp:tempest-client-scenarios
Make SwiftScenarioTest methods public

An earlier refactoring (commit
0d49411dbb7d6818bb6ca82ba5b769eeffd8f305) extracted the test manager
to a new class. In order to limit the surface area of the change
existing methods name were left unchanged.

This change updates those method names to make them explicitly
public so future test developers recognize their availability.

Change-Id: I3f3492dbe122797d9683e84373830e820cd8c038
Add a test for deleting multiple objects by POST method

From swift Icehouse version, bulk deletion supports POST method as well as
DELETE.

Extra fixes:
 - Bulk is an optional function with WSGI middleware, therefore each test
   is annotated with @test.requires_ext
 - Refactor test_account_bulk.py by separating common codes to one method
 - Simplify delete_account method of the Swift's account service client

Partially implements blueprint add-icehouse-swift-tests

Change-Id: I3b63bc730f993cdb626c5a77c18ae917d98e911b
Support lack of ephemeral volumes for baremetal

The agent driver in Ironic does not yet support ephemeral volumes.
This change allows tempest to test Ironic with the agent driver
by skipping ephemeral volume checks if the ephemeral volume size
is 0.

Change-Id: I9525d1c75007555d368a2aa66ab840f41b584a30
large ops test should be derived from OfficialClientTest

Scenario test_large_ops runs on gate-tempest-dsvm-large-ops
& gate-tempest-dsvm-neutron-large-ops jobs.

This test case boot VM with security grp by requesting the same from
Nova. Nova can behave as proxy in case neutron is enabled.

This is needed to migrate this test from official
client to tempest client as _create_security_group() fucntion
which request nova to create sec grp can not be used via
NeutronScenarioTest.

Partially-implements: bp:tempest-client-scenarios

Change-Id: I7b69811b49caf3aec5983e27862ce955aadf958a
Migrate test_large_ops to tempest client

This patch migrate the test_large_ops scenario tests
from official client to tempest clients.

Partially-implements: bp:tempest-client-scenarios

Change-Id: I417fba287f212667e08b3b246f222b60249e47b1
Backward compatibility to credentials in conf

Before switching to the YAML based configuration as the default for
credentials, we need to introduce backward compatibility to allow
credentials to be configured in tempest.conf.

Partially implements bp:test-accounts

Change-Id: I29c66c87d02f442b1d5b0b2d7c82ff2a140c111f
Add test list_servers_filtered_by_name_regex

The nova servers API supports full regex filtering on names. Add a test
for basic regex support.

Change-Id: Iddd5908d7daa5d5b20cb29dd0f403fcdd3ecefcf
Unskip test_create_and_get_delete_bucket()

test_create_and_get_delete_bucket() was skipped because of bug 1076965
which is now in a state which should allow us to unskip it.

Change-Id: I56bc2bfb5a3019cf4a2979b40c7d7cbe3c8cf71a
Related-Bug: #1076965
Unskip test_rescope_token()

test_rescope_token() was skipped  because of bug 1351026 which is now
in a state which should allow us to unskip it.

Change-Id: Ia0fd713fea041c24f4ff1f041a48d9bac7fef6e7
Related-Bug: #1351026
Unskip test_update_port_with_second_ip()

test_update_port_with_second_ip() was skipped because of bug 1364166
which is now in a state which should allow us to unskip it.

Change-Id: I263bd4ef45ea02b18c6d00b6e27f0b12442be9ee
Related-Bug: #1364166
Remove PYTHONHASHSEED=0 from tox.ini

We've ironed out remaining issues that crop up when running
with a random seed. This updates tox.ini to revert to the default
behavior of running with PYTHONHASHSEED=random.  The pep8 check
continues to run with PYTHONHASHSEED=0 to workaround oslo issues
around config value ordering in the check_uptodate.sh test.

Change-Id: Ifa0dba8c3970fc676d374f33c129ef0f9d526c94
Migrate test_server_cfn_init to tempest clients

Migrate the test and change OrchestrationScenarioTest used by the test.
This is a part of the migrating all scenario tests to using tempest own
clients.

Change-Id: Iafc1b021fe8a9a5daa0e2d7eef0542b7929c415a
Partially-implements: bp:tempest-client-scenarios
Add response schema for V2 sec grp default rule

This patch adds response schema for nova V2
'os-security-group-default-rules' APIs.

Response body of create/show 'os-security-group-default-rules' -
{
    "security_group_default_rule": {
        "from_port": 80,
        "id": 1,
        "ip_protocol": "TCP",
        "ip_range":{
            "cidr": "10.10.10.0/24"
        },
        "to_port": 80
    }
}

Response body of list 'os-security-group-default-rules' -
{
    "security_group_default_rules": [
        {
            "from_port": 80,
            "id": 1,
            "ip_protocol": "TCP",
            "ip_range": {
                "cidr": "10.10.10.0/24"
            },
            "to_port": 80
        }
    ]
}

Delete API only returns 204 status code.

Change-Id: Id24857ee95445570d45aac3e1a25e607d8df78d1