Updated openstack/openstack
Project: openstack/neutron  415b94595ffabf4658c39b569e7e7e6cc583d1b1

Add functional testing to ipset_manager

Add functional testing to the ipset_manager module to verify
it works as expected in combination with iptables matching.

Implements:  blueprint add-ipset-to-security

Change-Id: Iec791ec30f87f6c00805f1d52c23b84aa7bc19de
Updated openstack/openstack
Project: openstack-dev/devstack  0a49fa517b1de363f45cfcb5b2dbfc710650916e

Fix Ironic agent ramdisk URL

This URL was wrong in the first place, not sure how that happened.

Change-Id: I8a9a19c9776c06d062751becf8382b9a014e45eb
Updated openstack/openstack
Project: openstack/nova  762dfae21fa298b1c8e90510cab03d58bf6259c8

Ironic: don't canonicalize extra_specs data

Don't canonicalize the cpu_arch extra_specs field. This is important
because the scheduler filters which use extra specs don't canonicalize
things either and as such you'll have mismatched fields causing
instances not to get scheduled.

This was recently changed as part of the Ironic -> Nova driver patch
series. We still want to canonicalize supported_instances though...

Change-Id: I9342213b5433113816142b1f737119065e9f077f
Closes-bug: #1366859
Updated openstack/openstack
Project: openstack/neutron  57ea43d2a550cb8c7d8ff8e4a2a3ffd0b488f744

Updated from global requirements

Change-Id: I7a53aedccdd62fafd0da2679e84345e71da5493d
Updated openstack/openstack
Project: openstack/neutron  f095f993302f63d88ae8e90826aad706277996ca

Fix KeyError on missing gw_port_host for L3 agent in DVR mode

The order of Mixin imports broke the MRO, which caused some methods
in the L3 hierarchy to be ignored. In particular, _build_routers_list
for DVR was no longer called, which led to the stacktrace observed on
the L3 agent side.

Closes-bug: 1369012

Change-Id: I23cd9813fb9b67e9029d222d5f72733ecec3febb
Updated openstack/openstack
Project: openstack/stevedore  4a410fe91a3d3ff1bf87d4a25a188f5161c2e06b

Update repository location in docs

After the move from stackforge the git repository location
in the documentation was no longer up to date.

Change-Id: I7ccb0abe188f4cdebd36b727f6a681aba370af0f
Updated openstack/openstack
Project: openstack/nova  df7b6e7700b801e0c7f0dcbbcb08d8161da87b0d

neutronv2: attempt to delete all ports

Previously when deleting ports during allocate
or deallocate, the operation would fail on the
first non-404 error encountered. We now loop
through all of the ports and attempt the delete.

In the allocate flow we don't raise any errors
since the instance is set to ERROR anyway and
we're just trying to cleanup.

In the deallocate flow we attempt to delete all
of the ports and if there was a non-404 exception
we raise that at the end so the overall instance
delete operation fails.

Change-Id: Ibf68e0b4770b09ee32f187b85f2ca96984117e0b
Closes-bug: #1292243
Co-Authored-By: Dan Smith <dansmith@redhat.com>
Co-Authored-By: Sean Dague <sean@dague.net>
Co-Authored-By: Matt Riedemann <mriedem@us.ibm.com>
Updated openstack/openstack
Project: openstack/nova  cf6c9bf76647c0819cca8328ee0563a6abba893e

Nova-net: fix server side deallocate_for_instance()

Client side of the network RPC API sets 'requested_networks'
parameter in deallocate_for_instance() call,
while server side expected 'fixed_ips' parameter.
This patch fixes server side so it handles 'requested_networks'

Closes-Bug: #1350355

Change-Id: If9554a2e98397c5e63e929e1606d99dd2328262c
Updated openstack/openstack
Project: openstack/nova  f70c1a81543d89c6b3191ae0ad62ee1e918cc104

Add new unit tests for PCI stats

These unit tests make sure that the stats pools are created and
ordered properly.

Partially Implements: blueprint pci-passthrough-sriov

Change-Id: I81591b18d1045a4451ce009b091b22875eb04890
Updated openstack/openstack
Project: openstack/nova  ebc6d50849d1beeb1059d8dcacae30a7937faadd

Process power state syncs asynchronously

The instance locking introduced in
cc5388bbe81aba635fb757e202d860aeed98f3e8 keeps the power state sane
between stop and the periodic task power sync.  However, locking on
an instance in the periodic task thread can potentially lock
that thread for a long time.

Fix this condition by executing power syncs in a background GreenPool.
Limit the syncs to 1 at a time per instance.

Closes-Bug: 1363231

Change-Id: Idbc00ddfcb7a6816433863ed1686ad8f7477d99b
Updated openstack/openstack
Project: openstack/nova  c79abb625c0a509733a4c0f12c1006d894d4a2d8

Stash numa-related flavor extra_spec items in system_metadata

This is a temporary measure to avoid having to add additional persistence
of extra_specs data simply to facilitate merging the NUMA patches. Only
the numa_cpus.* and numa_mem.* items are saved from extra_specs at
this time. The expectation is that this will quickly come out in kilo
when the rest of the flavor information stashed in system_metadata gets
removed and stored elsewhere.

Blueprint: virt-driver-numa-placement
Change-Id: I83ca863d521c579d8f1fe6168d7b1096af9f14f1
Updated openstack/openstack
Project: openstack/nova  763696462a23c5b55eea8ffcdd679086b3e268cd

Hook NUMA topology checking into claims

This patch adds the ability to test claims against NUMA topology exposed
by the host and instance. This is currently a no-op as no code in the
scheduler will actually attempt to set the limits against numa_topology.
Since getting the NUMA topology of the instance may require an additional
db roundtrip, we try to avoid getting it unless absolutely necessary.

This patch also changes the resource_tracker resize_claim method to
accept the image_metada of the instance as it is used (alongside flavor)
to calculate the new topology that will be exposed after the resize is
done.

The resource tracker will not do any actual usage tracking yet - this
will be done in a follow-up patch.

Blueprint: virt-driver-numa-placement
Change-Id: I07b690243d481c855c5e706f968cf224b336a1a0
Updated openstack/openstack
Project: openstack/nova  9aa1bd5e1025717c3c5f0ad06edf78b30d0e9ef7

Make resource tracker track NUMA usage

This patch makes the resource tracker actually track and update NUMA
usage from instance andd resize claims, and periodic resource updates.

Change-Id: Iea9d076cb37e530f442faefacd2a59b6b6225e92
Blueprint: virt-driver-numa-placement
Updated openstack/openstack
Project: openstack/nova  9fdddeb6d3ef399d08da21adc1f182f3ee9c50ea

API boot process sets NUMA topology for instances

This patch makes the API instance boot path look at the bits that can
contain requested topology, generate the desired topology and make sure
it is saved on the instance itself.

We also need to account for the flavor passed to
VirtNUMAInstanceTopology.get_constraints not being an actual Flavor
object, and work with db layer objects.

Change-Id: Ia3f3446da99a04e2d8152acb7d0bda7a1d502c83
Blueprint: virt-driver-numa-placement
Updated openstack/openstack
Project: openstack/python-keystoneclient  3305c7be4b726de4dcc889006d0be30eb46d3ad9

Sync with latest oslo-incubator

Last commit: 32e7f0b56f527427544050f251999f3de588ac93

This patch syncs the python-keystoneclient with olso-incubator as I
need this patch 4ef01931 which fixes a bug that's I am hitting in
another client which uses the keystoneclient.

Closes-bug: 1277565

Change-Id: I22f10f4fe27be16a6808b75c154ee342fea2bdda
Updated openstack/openstack
Project: openstack/heat  ab7f642844e494b626cddfb390781e8fd2f4770a

Replace marconi by zaqar in heat plugins

Change-Id: I9eb68c27e79782f0da0d9a79bf231e09f2f679bc
Updated openstack/openstack
Project: openstack/nova  8fe2d6721af1da5fe2763c3ac22f02d61ea3f861

Make HostManager track NUMA usage

This patch adds tracking of NUMA usage in scheduler's HostManager class,
by adding it to the HostState, and making sure it gets updated along
with all the other usage data.

Change-Id: Id31c9a7fd54b918b3d38abb61b305cf7048a6a7d
Blueprint: virt-driver-numa-placement
Updated openstack/openstack
Project: openstack/nova  f61c4a3f5a3c92428f0e2495aca1040814c3a368

Add the NUMATopologyFilter

This patch adds the basic NUMA filter that will take the proposed
instance topology and try to match it against that of a host.

The matching will be done in the following manner:

 * Filter will try to match the exact NUMA cells of the instance to those
   of the host. It *will not* attempt to pack the instance onto the host.
 * It will consider the standard over-subscription limits for each cell,
   and provide limits to the compute host accordingly.
 * If instance has no topology defined, it will be considered for any host.
 * If instance has a topology defined, it will be considered only for NUMA
   capable hosts.

DocImpact

Change-Id: I8788dde69524c8a32a41ce31a96c89f9b09e91ce
Blueprint: virt-driver-numa-placement
Updated openstack/openstack
Project: openstack/nova  021c44319c61b71ce827024e5f8245f62bc78484

libvirt: Consider numa_topology when booting

This patch hooks all the already introduced pieces together to enable
NUMA aware placement of instances.

The libvirt driver boot process now looks into the NUMA topology field
of both instance and the host it is being booted on, and based on that
adds some more configuration to the generated guest XML.

In case the host is NUMA capable, but the instance has not requested
a NUMA topology, we will try to pack the instance into a single cell.
If that fails, currently we will not make further attempts (although
an improvement could be to expose the underlying topology to the
instance).

In case the host is NUMA capable, and instance has requested a specific
NUMA topology, we will try to pin the vCPUs of different instance NUMA
cells to the corresponding host NUMA cells, and also expose the instance
NUMA topology to the guest OS.

We will still try to respect CONF.vcpu_pin_set option and avoid pinning
to CPUs that are not in this set.

DocImpact

Change-Id: I611d44ab75475028f63c2b7f8a0d2ef37d85be6e
Blueprint: virt-driver-numa-placement
Updated openstack/openstack
Project: openstack/cinder  c952c6535688f64897957b092ac26d72ac9c64db

Destroy Datera export target after detach

Since there is only one lun associated with each target export object in
the Datera backend, we will destroy the target export object after
detaching the volume so they don't build up. This patch also fixes some
missing values for formatted strings.

Closes-Bug: #1368381
Change-Id: Id44ac4bb385ab39af50865a295938861ca977fa3