Fix incorrect root partition size and compatible volume name

When using rbd backend, it needs to resize volume size if size presents. Else
we will get wrong image size.

Rbd volume always uses uuid as the main pattern of volume name, now change to
it is necessary.

Fix bug 1219658

Change-Id: I3dc8d639b066eac35d190b8d4687c41c9f4d5824
(cherry picked from commit 1b66a47b5f4cbcdf1a9a1ec38532474588a3fee2)

Upstream-review: https://review.openstack.org/#/c/87455/
Not-in-upstream: yet
Partial-rally-bug: DE727
Partial-rally-bug: DE642
make rbd usable for ephemeral storage

Currently when using rbd as an image backend, nova downloads the
glance image to local disk and then copies it again into rbd.  This
can be very slow for large images, and wastes bandwidth as well as
disk space.

When the glance image is stored in the same ceph cluster, the data is
being pulled out and pushed back in unnecessarily. Instead, create a
copy-on-write clone of the image. This is a fast, and does not depend
on the size of the image. Instead of taking minutes, booting takes
seconds, and is not limited by the disk copy.

Add a direct_fetch() method to the image backend, so backends
like rbd can make optimizations like this. Try to use direct_fetch()
for the root disk when it comes from an image, but fall back to
fetch_to_raw() if direct_fetch() fails.

The majority of this code was taken from the cinder rbd driver.
The only new parts are the direct_fetch() method for the image
backend, and the small backwards-compatible interfaces changes
needed to make use of it.

fixes bug 1226351

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Change-Id: Ic9b9fbcb6e133cc9315581354f1b70ed7c9909ad

Closes-Bug: 1226351
Abandoned-upstream-review: https://review.openstack.org/#/c/46879/
Not-in-upstream: true
Partial-rally-bug: DE727
Partial-rally-bug: DE642
imagebackend: make verify_base_size() behave for rbd

verify_base_size() calls disk.get_disk_size(), which assumes the disk
is stored locally.

Instead of calling disk.get_disk_size() directly from
verify_base_size(), add a new method that is overridden by the Rbd
subclass to get the disk size.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Not-in-upstream: true
Partial-rally-bug: DE727
Partial-rally-bug: DE642
Add max_size to direct_fetch

Not-in-upstream: true
Partial-rally-bug: DE727
Partial-rally-bug: DE642
Improve shared storage checks for live migration

Distinguish cases that require shared instance drive and shared libvirt
instance directory. Reflect the fact that RBD backed instances have
shared instance drive (and no shared libvirt instance directory) in the
relevant conditionals.

Not-in-upstream: true
Partial-rally-bug: DE727
Partial-rally-bug: DE642

Note that a derivitive of this has been committed to upstream/master
in Juno and it should therefore be safe to drop this patch
after Icehouse: https://review.openstack.org/#/c/91722/
Fix dictionary update and key issues, update tests

Not-in-upstream: true
Partial-rally-bug: DE727
Partial-rally-bug: DE642
Pass rbd_user id and conf path  as part of RBD URI for qemu-img

Unlike rados.py, qemu-img does not use id from CEPH_ARGS and has to be
given a ceph user id and conf path explicitly in RBD URI

Closes-Bug: #1261675
Change-Id: I9226515f2a860ed45d12012fd5b6bc7e842f6d32
(cherry picked from commit 9e7e8daa66f0c05ac7ce3927562d246baf70067f)

Upstream-review: https://review.openstack.org/#/c/62592/
imagebackend: import rbd options

This makes unit tests happy

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Not-in-upstream: true
Partial-rally-bug: DE727
Partial-rally-bug: DE642
imagebackend: handle iso images correctly with rbd

iso images are raw from qemu's perspective, so
allow cloning them. They just need to be exposed to
the guest as cdroms instead of disks.

This is handled by the disk config's source_device
attribute, not device_type. Use the correct attribute
in libvirt_info().

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Not-in-upstream: true
Partial-rally-bug: DE727
Partial-rally-bug: DE642