Move negative tests for test_images

This submission adds new test script "test_images_negative.py"
Which has negative tests separated from test_images.py

Partially implements blueprint negative-test-files

Change-Id: Id9b841b9cfca6461185674b7bf2c3777a130a900
Add basic Delete Queue Marconi test

Add a smoke test that deletes a queue.
Add TestManageQueue test class for scenarios that require
a queue to be created as a pre-requisite.

Change-Id: I01b1ab266514a634b6f50852715e46f701285b0f
Implements: blueprint add-basic-marconi-tests
Add list user groups api to identity v3

Identity v3 lack of list user groups, so I do the addition.
To test the addition, I add a test :
- test_list_user_groups

Change-Id: I5924b7c6c9dfe61cb4089ad9a09d2da0c0bd18c4
Add return value of classmethod in network base.py

Add return value for create_router_interface method

Change-Id: Ieeeaf55e71847372452b2c0ed18eea92ddd3e034
Add unit tests for the tempest.common.utils.file_utils

This commit adds a positive and negative unit tests for the single
method from file_utils in tempest.common.utils.

Partially implements bp unit-tests

Change-Id: Ic19428a10785afd8849442f4d1f8f8e0a87f549b
add volume list tests for cinder v2

cinder v2 allows parameters limit, sort_key and sort_dir in query
statement. Add tests for the query parameters.

Change-Id: I3b713f3d830879b4e8e675910366c21953e342db
Blueprint: cinder-v2-api-tests
Networks,Ports: delete with subnet, port with no IP

Following tests are added:
 - Delete a subnet by deleting the network it is associated with
 - Test create port with no IP address

Change-Id: Ia6ff87b122615fea685cc645cd0213cda2a769b7
Verify Image attributes through Nova V2 GET API

This patch adds the JSON Schema for response of Nova V2 GET Image API
and validate the response with added JSON Schema to block the backward
incompatibility change in the future.

The response body of V2 GET Image API is below:

{
    "image": {
        "id": "70a599e0-31e7-49b7-b260-868f441e862b",
        "status": "ACTIVE",
        "updated": "2011-01-01T01:02:03Z",
        "links": [
            {
                "href": "http://openstack.example.com/v2/openstack/
                        images/70a599e0-31e7-49b7-b260-868f441e862b",
                "rel": "self"
            },
            {
                "href": "http://openstack.example.com/openstack/
                        images/70a599e0-31e7-49b7-b260-868f441e862b",
                "rel": "bookmark"
            },
            {
                "href": "http://glance.openstack.example.com/openstack/
                        images/70a599e0-31e7-49b7-b260-868f441e862b",
                "rel": "alternate",
                "type": "application/vnd.openstack.image"
            }
        ],
        "name": "fakeimage7",
        "created": "2011-01-01T01:02:03Z",
        "OS-EXT-IMG-SIZE:size": 25165824,
        "minDisk": 0,
        "minRam": 0,
        "progress": 100,
        "metadata": {
            "architecture": "x86_64",
            "auto_disk_config": "True",
            "kernel_id": "nokernel",
            "ramdisk_id": "nokernel"
        },
        "server": {
            "id": "65802d04-c684-4900-b645-a6a15f78add4",
            "links": [
                {
                    "href": "http://10.21.43.120:8774/v2/
                            f0468e49de7b4f74b6359a6dd3a72481/servers/
                            65802d04-c684-4900-b645-a6a15f78add4",
                    "rel": "self"
                }
            ]
        }
    }
}

Partially implements blueprint nova-api-attribute-test

Change-Id: I3f09f5857ad35bc9f703a0482c761ae2ec2418f1
Add tests for external network extension

Add tests for:
 - Create a network from an administrative user specifying the
   external network extension attribute;
 - Update a network from an administrative user specifying the
   external network extension attribute;
 - List networks from a normal user and confirm the external
   network extension attribute is returned for those networks
   that were created as external;
 - Show an external network from a normal user and confirm the
   external network extension attribute is returned.

partially implement bp: improve-neutron-test-coverage

Change-Id: I3e4978b95d0f0194a698f3b7929f90c23cb8345e
Stop heat resource leaking even if an error occurs

In some test, if an error occurred in setUpClass(), some resources
are not deleted because of tearDownClass() is not called.
This commit fixes it.

 tempest/api
  +---- baremetal (unnecessary)
  +---- compute
  +---- data_processing (unnecessary)
  +---- database (unnecessary)
  +---- identity
  +---- image (done)
  +---- network
  +---- object_storage
  +---- orchestration         <-- this patch
  +---- queuing (unnecessary)
  +---- telemetry (unnecessary)
  +---- volume (done)

Partially Implements: blueprint stop-leaking

Change-Id: Ice13507f4b7625b73fe200c414fa4d7b9be856d5
Stop keystone resource leaking even if an error occurs

In some test, if an error occurs in setUpClass(), some resources
are not deleted because of tearDownClass() is not called.
This commit fixes it.

 tempest/api
  +---- baremetal (unnecessary)
  +---- compute
  +---- data_processing (unnecessary)
  +---- database (unnecessary)
  +---- identity            <-- this patch
  +---- image (done)
  +---- network
  +---- object_storage
  +---- orchestration
  +---- queuing (unnecessary)
  +---- telemetry (unnecessary)
  +---- volume (done)

Partially Implements: blueprint stop-leaking

Change-Id: I7104b968b7c704d465ec8a5a3046f749566c1241
Add error handling if testscenarios aren't supported

If the test runner doesn't support the load_tests mechanism it's
better to raise an proper exception.

Change-Id: I3f5d4b2bc285874bbeabf8ddefec6c28fd2b9c91
Closes-Bug: #1293433
Verify quotas attributes through Nova os-quota-sets API

This patch adds checks whether a response of Nova os-quota-sets
get/get defaultAPI
includes the attributes to block the backward incompatibility change
in the future.

The quotas response body of v2 API is the following:
{
    "quota_set": {
        "id": "231a1e7fd1b344f9874d0334d98b459c",
        "instances": 10,
        "cores": 20,
        "ram": 51200,
        "floating_ips": 10,
        "fixed_ips": -1,
        "metadata_items": 128,
        "injected_files": 5,
        "injected_file_content_bytes": 10240,
        "injected_file_path_bytes": 255,
        "key_pairs": 100,
        "security_groups": 10
        "security_group_rules": 20,
    }
}

The one of v3 API is the following:
{
    "quota_set": {
        "id": "231a1e7fd1b344f9874d0334d98b459c",
        "instances": 10,
        "cores": 20,
        "ram": 51200,
        "floating_ips": 10,
        "fixed_ips": -1,
        "metadata_items": 128,
        "key_pairs": 100,
        "security_groups": 10
        "security_group_rules": 20,
    }
}

Partially implements blueprint nova-api-attribute-test

Change-Id: I8a45ba601b92f17808227a4853a42e812a2a082e
API test for 'create server with scheduler hints'

It implements nova api test to create a server with scheduler
hints. To test this API 'SimpleCIDRAffinityFilter' filtering
schema is used.

Change-Id: Idfd53edf55735075af3b0601bf4e5181378f1d47
Merge "Networks,Ports: delete with subnet, port with no IP"
Merge "Move negative tests for test_images"
Merge "Add unit tests for the tempest.common.utils.file_utils"
Merge "API test for 'create server with scheduler hints'"
add back empty whitelist

the log checker fails without a whitelist file, add this back in

Change-Id: I26f0e9789b167061e2a7dac4dddf04d89bfadee3
Merge "Add tests for external network extension"