VMware: deprecate ESX driver from virt configuration

Remove the VMware ESX driver configuration from the virt driver
configuration help options.

The commit d041b95b8977e77a51e6031c38f0011b44d3266a marked the
VMware ESX driver as deprecated. This is the first step in
starting to remove the driver in Juno.

Change-Id: I955ffee336feeca68994d9ea4e244f3c7e10eed2
Fix EC2 not found errors for volumes and snapshots.

According to AWS docs
(http://docs.aws.amazon.com/AWSEC2/latest/APIReference/
api-error-codes.html)

Change-Id: I43af230b975263bb2a14e0cc0bd8718f55bd8a55
Closes-Bug: #1323813
Handle service creation race by service workers

This handle a race where a sibling has already created the service
record in the database.  This fix is similar to that of commit
f6c341b4.

Change-Id: I7975fc632eee34390c5d7dc275b52363ad45475e
Closes-bug: 1326901
api: remove dead code in WSGI XML serializer

Change-Id: I3a08da32a55ac732366e9c3821f39697cd0e2ecd
libvirt: add '_' prefix to host state information methods

The methods used by the HostState class are all internal
helpers so should have a '_' prefix to indicate they are
not part of public virt driver API.

Related-bug: #1333219
Change-Id: Ia9b2e966071d5a842193421394aa0850beb3fdba
Sync log and processutils from oslo

This is mainly to pick up two changes in processutils:

85f1784 Move nova.utils.cpu_count() to processutils module
cdcc19c Mask passwords that are included in commands

Commit cdcc19c touches the log module so when copying processutils over
we also copy log, otherwise no other dependencies are copied.  Going
through the commit history on both and the diff from nova, there are no
other commits sync'ed over that require changes to other dependent
modules.

Commit 85f1784 is targeted so we can remove the redundant code from
nova.utils.

Changes:

processutils
------------
85f1784 Move nova.utils.cpu_count() to processutils module
cdcc19c Mask passwords that are included in commands
8a0f567 Remove str() from LOG.* and exceptions
51778f9 Allow passing environment variables to execute()

log
---
109e325 Use oslo.messaging to publish log errors
de4adbc pep8: fixed multiple violations
eac71f5 Fix common.log.ContextFormatter for Python 3
d78b633 Fixes a simple spelling mistake
621d831 always log a traceback in the sys.excepthook
90ae24b Remove redundant default=None for config options
af36c2a Fix logging setup for Python 3.4
cdcc19c Mask passwords that are included in commands

Partial-Bug: #1320028
Related-Bug: #1333370

Change-Id: I8d12661782e8ad065b01aa582e42c142cc2f4076
Fix agent_id with string type in API samples files for os-agents v2

The agent_id should be integer for agent create and index. But in
the api sample file it is string type. It's because the api sample
tests provide agent_id with string type in fake data. This patch
correct the api sample files and tests.

For agent update, it use agent_id that passed from url, make the
response use string for agent_id. We can't fix this problem for
back-compatibility. This will be fix in the future after v3 API
expose by micro-version

Change-Id: I262b4b26c94dba003e80bda2f38d2e985ef9f220
Partial-Bug: #1333494
Xen: Remove extraneous logging of type information

There doesn't appear to be any value in logging the type of vdi_rec
after its value has just been logged.  It's just adding noise to the
logs.

Change-Id: Ia5ccc634375d9a4fa4783487908cb4f91f435a68
Log when nova-conductor connection established

The current warning in wait_until_ready() is a bit of a red-herring.
When just looking at the logs, it's warning status may lead you to
believe the failure to connect to nova-conductor is fatal when really
it was retried and connected successfully.

The WARNING message on timeout is modified to clearly show that it is
retrying the connection.  A partner message is shown to inform that
the connection has been established.

Change-Id: I2040707df7caf8685c84c82ec9b8cc97cb04b47e
Merge "Xen: Remove extraneous logging of type information"
Revert "Sync revert and finish resize on instance.uuid"

This reverts commit d27987fa56156392c06b1185b44e36dc9720435c which
actually seems to have retriggered the issue it was designed to fix.

Related-Bug: #1326778

Change-Id: Ia1905177de8494f9c3abb3bcfa0866c7bcb33f93
Use dot notation to access instance object fields in ec2 create_image

The create_image method is using an instance object now so access the
fields using dot notation rather than treating it like a dict.

Also re-uses the in-scope instance_uuid variable rather than
instance.uuid for the name_map dict creation.

Change-Id: Ia80277830dc7230fb113e6f15efc773342ea4572
Merge "Fix EC2 not found errors for volumes and snapshots."
Merge "libvirt: add '_' prefix to host state information methods"
Merge "Revert "Sync revert and finish resize on instance.uuid""
Merge "Fix agent_id with string type in API samples files for os-agents v2"
Merge "Use dot notation to access instance object fields in ec2 create_image"
Merge "Sync log and processutils from oslo"
Updated from global requirements

Change-Id: Iaf117fa1ef752da09f2a0840baa9258dea9b3a61
Merge "Handle service creation race by service workers"