cleaning up index.rst file

Removed notes about the generation of the file.

Change-Id: I70bf5438a8fea9ca4f785313db4975b328f3a749
Fixed argument parsing in run script

Replaced += with = when adding arguments to the testrargs string
to prevent the script from doubling in length with each additional
argument.

Change-Id: If0ab41d6062c83cee50f830ffd9428c1302fd997
Closes-Bug: #1325405
Replace the console output on Error with fault a message

Trying to get the console log from an ERROR-ed server
does not really works

The console log does not contains any meaningful info
related to most status changes,
it is just what the instance prints to the serial console.

Only one action is guest assisted: the 'soft reboot',
which automatically switched to 'hard reboot'
when the guest forgets to assist
(ie. does not shutdown in 120 sec)

Testing the console output presence before reporting
active state would make more sense.

Instead of attempting to get the serial console output,
after this change the response 'fault' field will be used
for exception detail when available.

Closes-Bug: #1332414

This reverts commit c1a3bbe37c6202562fad5ff1be6e818d12797aee.

Change-Id: I2018f98cdc4a1bc7dd8f34833df228dc56d88a95
Add python-ceilometerclient in requirements

With the addition of the ceilometer client in the scenario tests, the
python-ceilometerclient is missing. This patch adds it to the packages
to be installed in requirements.txt.

Change-Id: Icb667def3afb71d20bc7a90e6e031cf671adc321
Closes-Bug: #1337309
Validate server detail list attribute of Nova APIs

This patch adds the JSON schema for Nova V2 & V3 server detail list
APIs response and validate the response with added JSON schema
to block the backward incompatibility change in the future.

The response body of server detail list V2 APIs is below:

{
    "servers": [
        {
            "accessIPv4": "",
            "accessIPv6": "",
            "addresses": {
                "private": [
                    {
                        "addr": "%(ip)s",
                        "version": 4
                    }
                ]
            },
            "created": "%(timestamp)s",
            "flavor": {
                "id": "1",
                "links": [
                    {
                        "href": "%(host)s/openstack/flavors/1",
                        "rel": "bookmark"
                    }
                ]
            },
            "hostId": "%(hostid)s",
            "id": "%(id)s",
            "image": {
                "id": "%(uuid)s",
                "links": [
                    {
                        "href": "%(host)s/openstack/images/%(uuid)s",
                        "rel": "bookmark"
                    }
                ]
            },
            "links": [
                {
                    "href": "%(host)s/v2/openstack/servers/%(id)s",
                    "rel": "self"
                },
                {
                    "href": "%(host)s/openstack/servers/%(id)s",
                    "rel": "bookmark"
                }
            ],
            "metadata": {
                "My Server Name": "Apache1"
            },
            "name": "new-server-test",
            "progress": 0,
            "status": "ACTIVE",
            "tenant_id": "openstack",
            "updated": "%(timestamp)s",
            "user_id": "fake"
        }
    ]
}

The response body of server detail list V3 APIs is below:

{
    "servers": [
        {
            "addresses": {
                "private": [
                    {
                        "addr": "%(ip)s",
                        "mac_addr": "aa:bb:cc:dd:ee:ff",
                        "type": "fixed",
                        "version": 4
                    }
                ]
            },
            "created": "%(timestamp)s",
            "flavor": {
                "id": "1",
                "links": [
                    {
                        "href": "%(host)s/flavors/1",
                        "rel": "bookmark"
                    }
                ]
            },
            "host_id": "%(hostid)s",
            "id": "%(id)s",
            "image": {
                "id": "%(uuid)s",
                "links": [
                    {
                        "href": "%(glance_host)s/images/%(uuid)s",
                        "rel": "bookmark"
                    }
                ]
            },
            "key_name": null,
            "links": [
                {
                    "href": "%(host)s/v3/servers/%(uuid)s",
                    "rel": "self"
                },
                {
                    "href": "%(host)s/servers/%(id)s",
                    "rel": "bookmark"
                }
            ],
            "metadata": {
                "My Server Name": "Apache1"
            },
            "name": "new-server-test",
            "progress": 0,
            "status": "ACTIVE",
            "tenant_id": "openstack",
            "updated": "%(timestamp)s",
            "user_id": "fake"
        }
    ]
}

Partially implements blueprint nova-api-attribute-test

Change-Id: Icafb0470402e59e9df3c81407f57c57b9e719fcb
Exclude volume tags while listing instance tags

When a volume is attached to an instance and then detached, a metadata
gets associated with the volume: 'readonly' = 'False', even if the volume
didn't have this entry before. The patch
https://review.openstack.org/#/c/70085/ against Nova adds support for
volume tags, and as a result, it breaks a test case where we are
asserting that no tags are left after deletion of them.
So this patch makes sure that we assert only for 'instance' tags, and
not volume tags.

Change-Id: Icdd8c3a2e6c9d3264afc141ad516ee06c6127336
Read template's expected value orchest test Part-1

In tests under /tempest/api/orchestration/, resources gets
created based on parameters defined in template (yaml, json).
But while verification of output, expected values are hard coded
in tests. Expected values should be read from template only.

This patch adds the helper to load the values from template
(yaml, json) and apply the changes in
tempest/api/orchestration/test_volumes.py

This patch also rename the existing load_template() function
as it read the template and newly added function load the template
This rename the load_template() to read_template in
tempest/api/orchestration/base.py and corresponding calling files.

Partial-Bug: #1327919

Change-Id: Ie0817e20cb7bacdf33b16fb222a7ee9c91109fc8
Skip baremetal tests if driver not supported

Adds a list of supported Ironic drivers that can be used for its API tests and
skips if the configured driver is not supported..  The list of supported
drivers will be extended/removed as we support API testing against clouds with
real drivers enabled.

Change-Id: I0b975548ff3656e8a052c79c7b9ffa1d8d721024
Partial-bug: #1334423.
Re-enable 'check_trust_roles'

Re-enable the 'check_trust_roles' method. This can be
merged after the patches for change id
I13ce159cbe9739d4bf5d321fc4bd069245f32734 are merged
(master and stable/icehouse for Keystone).

This changeset updates the new location for the check_trust_role
HTTP status validation (in services/identity/v3/json/identity_client.py).
Previously this was located in identity/admin/v3/test_trusts.py.

Commented code indicating the above location change occurred has been
removed.

Change-Id: If1b7f18d7a357f4b3a4b478e300a17f2cc4a6159
Closes-Bug: #1334368
Correct volume type api schema validation

Volume type in api response body can be None, so add None value to
volume create and list api  schema validation.

Closes-bug: 1341924

Change-Id: I151b407ea2ec871375cbf96f41269fd8a5414a29
Adds list users tests in v3

This submission adds test_list_users.py which has
list users with params test cases. Hence made changes
in client methods accordingly.

Change-Id: I264440772c2138ddbac74e68f227c6fb989c7b9f
Correct misspelled words

Correct some misspelled words:
responCe => responSe,
unkown => unkNown
infomation => infoRmation.

Change-Id: If0f8c2b71381be087694654969d7ea1483da7b17
Create test images via Glance instead of Nova

When possible, create blank test images in Glance instead of relying on
snapshotting, which may not be supported on the hypervisors under test.

Change-Id: I56f79b0ae718b2dcc43853bed3a792f15eccc313
Skip hypervisor uptime test for baremetal

Baremetal and ironic drivers have no concept of a hypervisor, thus
they do not implement the get_host_uptime() virt driver API call.
We would have to modify the underlying Tempest class that does the REST
calls to consider HTTP 501 (Not Implemented) successful, which would
affect the entire test suite. Instead, we just skip this test if
the baremetal/ironic driver is enabled.

Change-Id: I00c4146148063f6b20396dcbd0c911a386e488b1
Closes-Bug: #1338711
Added Heat Software Config-Deploy API tests

Added functions to the JSON client to support the new software
configuration API.
Software configurations and deployments are tiered and dependant on each
other so splitting the API calls to smaller tests is impossible.
Each test verifies different things, this is how I tried to prevent the
tests from being too bloated.

Co-Authored-By: Steven Hardy <shardy@redhat.com>
Change-Id: Ied896fcaf3cf4a80385b28235eb5f4af9cd182c8
Make javelin check logging a bit better

Add some more logging to javelin to help us figure out where 'check' is
failing.

Change-Id: Iea1ad2d11620bdd30692d7a11af8963531379c14
Removed deprecated command from glance cli

Member-add is no longer a command in python-glanceclient and
should be removed since it has been deprecated. We are removing
all the deprecated glance client commands in this patch 
https://review.openstack.org/#/c/98862/.

Change-Id: I69f7ca5ca0e1d9505334f081b7de1f43e6b2f86c
Merge "Validate server detail list attribute of Nova APIs"
Verify get_instance_action attributes of Nova API

This patch adds the JSON schema for Nova V2 & V3 get_instance_actions
API response and validate the response with added JSON schema
to block the backward incompatibility change in the future.

The response body of get_instance_actions V2 API is below:
{
    "instanceAction": {
        "action": "reboot",
        "instance_uuid": "b48316c5-71e8-45e4-9884-6c78055b9b13",
        "request_id": "req-3293a3f1-b44c-4609-b8d2-d81b105636b8",
        "user_id": "789",
        "project_id": "147",
        "start_time": "2012-12-05 00:00:00.000000",
        "message": "",
        "events": [
            {
                "event": "schedule",
                "start_time": "2012-12-05 01:00:02.000000",
                "finish_time": "2012-12-05 01:02:00.000000",
                "result": "Success",
                "traceback": ""
            },
            {
                "event": "compute_create",
                "start_time": "2012-12-05 01:03:00.000000",
                "finish_time": "2012-12-05 01:04:00.000000",
                "result": "Success",
                "traceback": ""
            }
        ]
    }
}

The response body of get_instance_actions V3 API is below:
{
    "server_action": {
        "action": "reboot",
        "server_uuid": "b48316c5-71e8-45e4-9884-6c78055b9b13",
        "request_id": "req-3293a3f1-b44c-4609-b8d2-d81b105636b8",
        "user_id": "789",
        "project_id": "147",
        "start_time": "2012-12-05T00:00:00.000000",
        "message": "",
        "events": [
            {
                "event": "schedule",
                "start_time": "2012-12-05T01:00:02.000000",
                "finish_time": "2012-12-05T01:02:00.000000",
                "result": "Success",
                "traceback": ""
            },
            {
                "event": "compute_create",
                "start_time": "2012-12-05T01:03:00.000000",
                "finish_time": "2012-12-05T01:04:00.000000",
                "result": "Success",
                "traceback": ""
            }
        ]
    }
}

Partially implements blueprint nova-api-attribute-test

Change-Id: I7b0d64b1db19359e5ff81b7cbbebef0b11946a1b
Adjust stress test documentation

Be more concrete about the stress test framework capabilities.

Change-Id: Ic331e47ffa0512179429176579f1e4a6caa82dfc