Add basic Delete Queue Marconi test

Add a smoke test that deletes a queue.
Add TestManageQueue test class for scenarios that require
a queue to be created as a pre-requisite.

Change-Id: I01b1ab266514a634b6f50852715e46f701285b0f
Implements: blueprint add-basic-marconi-tests
Add list user groups api to identity v3

Identity v3 lack of list user groups, so I do the addition.
To test the addition, I add a test :
- test_list_user_groups

Change-Id: I5924b7c6c9dfe61cb4089ad9a09d2da0c0bd18c4
Add return value of classmethod in network base.py

Add return value for create_router_interface method

Change-Id: Ieeeaf55e71847372452b2c0ed18eea92ddd3e034
add volume list tests for cinder v2

cinder v2 allows parameters limit, sort_key and sort_dir in query
statement. Add tests for the query parameters.

Change-Id: I3b713f3d830879b4e8e675910366c21953e342db
Blueprint: cinder-v2-api-tests
Verify Image attributes through Nova V2 GET API

This patch adds the JSON Schema for response of Nova V2 GET Image API
and validate the response with added JSON Schema to block the backward
incompatibility change in the future.

The response body of V2 GET Image API is below:

{
    "image": {
        "id": "70a599e0-31e7-49b7-b260-868f441e862b",
        "status": "ACTIVE",
        "updated": "2011-01-01T01:02:03Z",
        "links": [
            {
                "href": "http://openstack.example.com/v2/openstack/
                        images/70a599e0-31e7-49b7-b260-868f441e862b",
                "rel": "self"
            },
            {
                "href": "http://openstack.example.com/openstack/
                        images/70a599e0-31e7-49b7-b260-868f441e862b",
                "rel": "bookmark"
            },
            {
                "href": "http://glance.openstack.example.com/openstack/
                        images/70a599e0-31e7-49b7-b260-868f441e862b",
                "rel": "alternate",
                "type": "application/vnd.openstack.image"
            }
        ],
        "name": "fakeimage7",
        "created": "2011-01-01T01:02:03Z",
        "OS-EXT-IMG-SIZE:size": 25165824,
        "minDisk": 0,
        "minRam": 0,
        "progress": 100,
        "metadata": {
            "architecture": "x86_64",
            "auto_disk_config": "True",
            "kernel_id": "nokernel",
            "ramdisk_id": "nokernel"
        },
        "server": {
            "id": "65802d04-c684-4900-b645-a6a15f78add4",
            "links": [
                {
                    "href": "http://10.21.43.120:8774/v2/
                            f0468e49de7b4f74b6359a6dd3a72481/servers/
                            65802d04-c684-4900-b645-a6a15f78add4",
                    "rel": "self"
                }
            ]
        }
    }
}

Partially implements blueprint nova-api-attribute-test

Change-Id: I3f09f5857ad35bc9f703a0482c761ae2ec2418f1
Add tests for external network extension

Add tests for:
 - Create a network from an administrative user specifying the
   external network extension attribute;
 - Update a network from an administrative user specifying the
   external network extension attribute;
 - List networks from a normal user and confirm the external
   network extension attribute is returned for those networks
   that were created as external;
 - Show an external network from a normal user and confirm the
   external network extension attribute is returned.

partially implement bp: improve-neutron-test-coverage

Change-Id: I3e4978b95d0f0194a698f3b7929f90c23cb8345e
Stop heat resource leaking even if an error occurs

In some test, if an error occurred in setUpClass(), some resources
are not deleted because of tearDownClass() is not called.
This commit fixes it.

 tempest/api
  +---- baremetal (unnecessary)
  +---- compute
  +---- data_processing (unnecessary)
  +---- database (unnecessary)
  +---- identity
  +---- image (done)
  +---- network
  +---- object_storage
  +---- orchestration         <-- this patch
  +---- queuing (unnecessary)
  +---- telemetry (unnecessary)
  +---- volume (done)

Partially Implements: blueprint stop-leaking

Change-Id: Ice13507f4b7625b73fe200c414fa4d7b9be856d5
Stop keystone resource leaking even if an error occurs

In some test, if an error occurs in setUpClass(), some resources
are not deleted because of tearDownClass() is not called.
This commit fixes it.

 tempest/api
  +---- baremetal (unnecessary)
  +---- compute
  +---- data_processing (unnecessary)
  +---- database (unnecessary)
  +---- identity            <-- this patch
  +---- image (done)
  +---- network
  +---- object_storage
  +---- orchestration
  +---- queuing (unnecessary)
  +---- telemetry (unnecessary)
  +---- volume (done)

Partially Implements: blueprint stop-leaking

Change-Id: I7104b968b7c704d465ec8a5a3046f749566c1241
Add error handling if testscenarios aren't supported

If the test runner doesn't support the load_tests mechanism it's
better to raise an proper exception.

Change-Id: I3f5d4b2bc285874bbeabf8ddefec6c28fd2b9c91
Closes-Bug: #1293433
Verify quotas attributes through Nova os-quota-sets API

This patch adds checks whether a response of Nova os-quota-sets
get/get defaultAPI
includes the attributes to block the backward incompatibility change
in the future.

The quotas response body of v2 API is the following:
{
    "quota_set": {
        "id": "231a1e7fd1b344f9874d0334d98b459c",
        "instances": 10,
        "cores": 20,
        "ram": 51200,
        "floating_ips": 10,
        "fixed_ips": -1,
        "metadata_items": 128,
        "injected_files": 5,
        "injected_file_content_bytes": 10240,
        "injected_file_path_bytes": 255,
        "key_pairs": 100,
        "security_groups": 10
        "security_group_rules": 20,
    }
}

The one of v3 API is the following:
{
    "quota_set": {
        "id": "231a1e7fd1b344f9874d0334d98b459c",
        "instances": 10,
        "cores": 20,
        "ram": 51200,
        "floating_ips": 10,
        "fixed_ips": -1,
        "metadata_items": 128,
        "key_pairs": 100,
        "security_groups": 10
        "security_group_rules": 20,
    }
}

Partially implements blueprint nova-api-attribute-test

Change-Id: I8a45ba601b92f17808227a4853a42e812a2a082e
add back empty whitelist

the log checker fails without a whitelist file, add this back in

Change-Id: I26f0e9789b167061e2a7dac4dddf04d89bfadee3
Merge "Add tests for external network extension"
Merge "Add list user groups api to identity v3"
Merge "Stop keystone resource leaking even if an error occurs"
Merge "Stop heat resource leaking even if an error occurs"
Merge "add volume list tests for cinder v2"
Merge "Verify quotas attributes through Nova os-quota-sets API"
Merge "Add return value of classmethod in network base.py"
Merge "Add basic Delete Queue Marconi test"
Merge "Add error handling if testscenarios aren't supported"