cleaning up index.rst file

Removed notes about the generation of the file.

Change-Id: I70bf5438a8fea9ca4f785313db4975b328f3a749
Fixed argument parsing in run script

Replaced += with = when adding arguments to the testrargs string
to prevent the script from doubling in length with each additional
argument.

Change-Id: If0ab41d6062c83cee50f830ffd9428c1302fd997
Closes-Bug: #1325405
Replace the console output on Error with fault a message

Trying to get the console log from an ERROR-ed server
does not really works

The console log does not contains any meaningful info
related to most status changes,
it is just what the instance prints to the serial console.

Only one action is guest assisted: the 'soft reboot',
which automatically switched to 'hard reboot'
when the guest forgets to assist
(ie. does not shutdown in 120 sec)

Testing the console output presence before reporting
active state would make more sense.

Instead of attempting to get the serial console output,
after this change the response 'fault' field will be used
for exception detail when available.

Closes-Bug: #1332414

This reverts commit c1a3bbe37c6202562fad5ff1be6e818d12797aee.

Change-Id: I2018f98cdc4a1bc7dd8f34833df228dc56d88a95
Make unable to ping log messages appropriate level

The ping from an ssh connection checks in _check_remote_connectivity()
aren't necessarily expected to pass on the first attempt. However,
every time the ping was unsuccessful the method would log an
exception which is too severe a log for an expected error. This
commit uses a more appropriate log level for this case.

Change-Id: I8068fa85472259676acebd99b9d191065661e101
Add parametric tests of Swift object API, part 4

Add positive tests of Swift object "COPY" APIs from the viewpoint of
completeness of query parameters.

Change-Id: Iada4a9e00ce66dccd46993fd3edcc39c625c9022
Remove unnecessary log message

This commit removes a useless log message from call_until_true. The
debug log there provides no useful debug information, just printing
that the sleep loop iterated doesn't enable any extra debugging. In
the worst case it ends up polluting the logs with the same message
while the loop times out. So let's just remove it.

Closes-Bug: #1336591
Change-Id: Ia0cec5c699470554a25c077082878772158f4c5a
Add python-ceilometerclient in requirements

With the addition of the ceilometer client in the scenario tests, the
python-ceilometerclient is missing. This patch adds it to the packages
to be installed in requirements.txt.

Change-Id: Icb667def3afb71d20bc7a90e6e031cf671adc321
Closes-Bug: #1337309
Validate server detail list attribute of Nova APIs

This patch adds the JSON schema for Nova V2 & V3 server detail list
APIs response and validate the response with added JSON schema
to block the backward incompatibility change in the future.

The response body of server detail list V2 APIs is below:

{
    "servers": [
        {
            "accessIPv4": "",
            "accessIPv6": "",
            "addresses": {
                "private": [
                    {
                        "addr": "%(ip)s",
                        "version": 4
                    }
                ]
            },
            "created": "%(timestamp)s",
            "flavor": {
                "id": "1",
                "links": [
                    {
                        "href": "%(host)s/openstack/flavors/1",
                        "rel": "bookmark"
                    }
                ]
            },
            "hostId": "%(hostid)s",
            "id": "%(id)s",
            "image": {
                "id": "%(uuid)s",
                "links": [
                    {
                        "href": "%(host)s/openstack/images/%(uuid)s",
                        "rel": "bookmark"
                    }
                ]
            },
            "links": [
                {
                    "href": "%(host)s/v2/openstack/servers/%(id)s",
                    "rel": "self"
                },
                {
                    "href": "%(host)s/openstack/servers/%(id)s",
                    "rel": "bookmark"
                }
            ],
            "metadata": {
                "My Server Name": "Apache1"
            },
            "name": "new-server-test",
            "progress": 0,
            "status": "ACTIVE",
            "tenant_id": "openstack",
            "updated": "%(timestamp)s",
            "user_id": "fake"
        }
    ]
}

The response body of server detail list V3 APIs is below:

{
    "servers": [
        {
            "addresses": {
                "private": [
                    {
                        "addr": "%(ip)s",
                        "mac_addr": "aa:bb:cc:dd:ee:ff",
                        "type": "fixed",
                        "version": 4
                    }
                ]
            },
            "created": "%(timestamp)s",
            "flavor": {
                "id": "1",
                "links": [
                    {
                        "href": "%(host)s/flavors/1",
                        "rel": "bookmark"
                    }
                ]
            },
            "host_id": "%(hostid)s",
            "id": "%(id)s",
            "image": {
                "id": "%(uuid)s",
                "links": [
                    {
                        "href": "%(glance_host)s/images/%(uuid)s",
                        "rel": "bookmark"
                    }
                ]
            },
            "key_name": null,
            "links": [
                {
                    "href": "%(host)s/v3/servers/%(uuid)s",
                    "rel": "self"
                },
                {
                    "href": "%(host)s/servers/%(id)s",
                    "rel": "bookmark"
                }
            ],
            "metadata": {
                "My Server Name": "Apache1"
            },
            "name": "new-server-test",
            "progress": 0,
            "status": "ACTIVE",
            "tenant_id": "openstack",
            "updated": "%(timestamp)s",
            "user_id": "fake"
        }
    ]
}

Partially implements blueprint nova-api-attribute-test

Change-Id: Icafb0470402e59e9df3c81407f57c57b9e719fcb
Exclude volume tags while listing instance tags

When a volume is attached to an instance and then detached, a metadata
gets associated with the volume: 'readonly' = 'False', even if the volume
didn't have this entry before. The patch
https://review.openstack.org/#/c/70085/ against Nova adds support for
volume tags, and as a result, it breaks a test case where we are
asserting that no tags are left after deletion of them.
So this patch makes sure that we assert only for 'instance' tags, and
not volume tags.

Change-Id: Icdd8c3a2e6c9d3264afc141ad516ee06c6127336
Merge duplicate code for network quotas tests

There is some duplicate code between test_quotas and test_lbaas_quotas.
To clearify the difference between them and the purpose, this patch merges
most code of them into a single internal method.

Change-Id: I05a9c92d052ea2f99694a588c2a3cebbde625166
Adds test for Sec group default rule Nova V2 API

This patch adds the test for below 'os-security-group-default-rules'
Nova V2 APIs-
- Create Security Group default rule
- Delete Security Group default rule
- List Security Group default rule
- GET Security Group default rule

This patch also adds the new json client.

Related-Bug: 1311500

Change-Id: Icf52a64b5719587cd02b906f3a0f8d17886241aa
Read template's expected value orchest test Part-1

In tests under /tempest/api/orchestration/, resources gets
created based on parameters defined in template (yaml, json).
But while verification of output, expected values are hard coded
in tests. Expected values should be read from template only.

This patch adds the helper to load the values from template
(yaml, json) and apply the changes in
tempest/api/orchestration/test_volumes.py

This patch also rename the existing load_template() function
as it read the template and newly added function load the template
This rename the load_template() to read_template in
tempest/api/orchestration/base.py and corresponding calling files.

Partial-Bug: #1327919

Change-Id: Ie0817e20cb7bacdf33b16fb222a7ee9c91109fc8
Read template's expected value orchest test Part-2

In tests under /tempest/api/orchestration/, resources gets
created based on parameters defined in template (yaml, json).
But while verification of output, expected values are hard coded
in tests.
Expected values should be read from template only.
This patch covers the following files -
    test_environment.py
    test_nova_keypair_resources.py
    test_swift_resources.py

Closes-Bug: #1327919

Change-Id: Ie241b7f299487cd0db384778225823e96fecf440
Enable some volumes v2 tests by sharing codes

1. create volumes v2 tests using the existent test class.
2. create a new test class for v1, which inherits v2.
3. add variable 'special_fields' to deal with the different
   field's name and reps code between v1 and v2.

This patch includes the following volumes tests:
- test_volume_metadata.py
- test_volume_transfers.py
- test_volumes_actions.py
- test_volumes_get.py
- test_volumes_negative.py

Partially implements: blueprint cinder-v2-api-tests

Change-Id: I30b8f38d1f8132ea28266a32d2c9cb912a70e2c3
Skip baremetal tests if driver not supported

Adds a list of supported Ironic drivers that can be used for its API tests and
skips if the configured driver is not supported..  The list of supported
drivers will be extended/removed as we support API testing against clouds with
real drivers enabled.

Change-Id: I0b975548ff3656e8a052c79c7b9ffa1d8d721024
Partial-bug: #1334423.
Avoid conflicts with other tests instances

Avoid conflicts with other instances that exist, for example when
weren't deleted in other tests. Just filter out them in test that
check instances amount by server IDs

Closes-Bug: #1340382
Change-Id: I51494c9f47745810583f682caadcd8772805733a
Re-enable 'check_trust_roles'

Re-enable the 'check_trust_roles' method. This can be
merged after the patches for change id
I13ce159cbe9739d4bf5d321fc4bd069245f32734 are merged
(master and stable/icehouse for Keystone).

This changeset updates the new location for the check_trust_role
HTTP status validation (in services/identity/v3/json/identity_client.py).
Previously this was located in identity/admin/v3/test_trusts.py.

Commented code indicating the above location change occurred has been
removed.

Change-Id: If1b7f18d7a357f4b3a4b478e300a17f2cc4a6159
Closes-Bug: #1334368
Add "capabilities:" to multiple_backends extra-spec key

cinder-scheduler uses all the "capabilities:" to scope the
cinder-volume. With no "capabilities:" prefix set in extra_spec,
it will be no effect from cinder-scheduler to schedule the
cinder-volume, which is not the purpose of the testcase.
To address the review comment, This change will not remove but
adds 2 cases for the "capabilities:" prefix to volume type key:
extra-spec "capabilities:volume_backend_name".

Change-Id: Ie870091f2a5657b3ab6a0171de2cffe6945a0f7c
Closes-Bug: #1295050
Correct volume type api schema validation

Volume type in api response body can be None, so add None value to
volume create and list api  schema validation.

Closes-bug: 1341924

Change-Id: I151b407ea2ec871375cbf96f41269fd8a5414a29
Adds list users tests in v3

This submission adds test_list_users.py which has
list users with params test cases. Hence made changes
in client methods accordingly.

Change-Id: I264440772c2138ddbac74e68f227c6fb989c7b9f