Sort modules in openstack-common.conf

Change-Id: I6339849c240de68a35cadf98de838240202db34f
Add support retrying rest call in IDH plugin

If rest call returned connection error, retrying call

Fixes bug: #1280269

Change-Id: I4d0551837f03791a364af630812764419e8f0a46
Filter credentials when returning job binaries through REST api

The 'extra' field for job binaries is used to store credentials
for accessing job binaries. Modify the JobBinary resource to
specify 'extra' as a filtered field.

Closes-bug: #1272322
Change-Id: I92c01bd8015e6e515081f83faa186de004a35a39
Enable HDP 2 deployment leveraging HDP plugin

This commit introduces the ability to deploy HDP 2.0.6 clusters.
Both basic cluster provisioning functions (create, scale) as well
as EDP have been implemented.

There is some follow on work required to complete the integration:

- Topology/data locality support
- Verify cinder support
- Refactoring (there is ample opportunity for extracting parent
classes for common code, etc)

I have filed bug #1277653 to track these items.

Most of the items above were not undertaken as part of this commit in
an attempt to limit the scope/size of the commit as well to allow for
an iterative approach for achieving full functionality.

partially implements blueprint hdp-hdp2-support

Change-Id: I1cc483f05b65e1df0fb630d5e819ef23ab407492
Fix cluster scaling in IDH plugin

Fixes bug: #1275096

Change-Id: I12d32a120b513454bb0221519057553e0f910d71
Add integration tests to Intel plugin

Tests:
* create templates
* create cluster
* scaling
* mapreduce

Partially implement blueprint: idh-integration-tests

Change-Id: I092284629bc42624103ef22110fb537d253c8fe7
Don't raise MySQL 2013 'Lost connection' errors

Closes-bug: #1276510

Although this code error is part of the `ping_listener` tests, it was
missing from the list of known - and ignored - connection errors.

The code error 2013 refers to a connection lost during a query, see:
https://dev.mysql.com/doc/refman/5.0/en/error-messages-client.html#error_cr_server_lost

Without this error code, the session won't try to reconnect to mysql,
which makes `max_retries` useless.

Change-Id: I006fd3ae88dd7ab61f7f8811562fb78ce4a331ad
Fix swift data source credential validation

The validation for swift data source credentials assumed that only the
elements within the credentials were missing. If the credentials
element itself was missing an internal error would be triggered.

Change-Id: I1c5d9673ae383eb8154508be01ceb67877b6e0cb
Closes-bug: #1277497
Use six.moves cStringIO instead of cStringIO

to keep Python 3.x compatibility, use six.moves.cStringIO to
replace StringIO

Change-Id: Iff3ecf55573dde287f5eeabfa7c15ef267fafb0c
Closes-Bug: #1280964
Keep py3.X compatibility for urllib

Use six.moves.urllib.parse instead of urllib

Partial-Bug: #1280105

Change-Id: I1f3fc34af98f60bd162b71d9a71afbc05affb1bf
Merge "Sort modules in openstack-common.conf"
Attach volumes in parallel

This patch speeds up attaching of Cinder volumes

Fixes bug: #1281030

Change-Id: I3687650a0941e6d2b036b5a4be20f0843cffb68a
Merge "Fix swift data source credential validation"
Merge "Add support retrying rest call in IDH plugin"
Merge "Fix cluster scaling in IDH plugin"
Merge "Enable HDP 2 deployment leveraging HDP plugin"
Add run_test.sh for running tests

This is a copy of the test entry point used in Nova, Swift, Keystone,
Tuskar, Glance, Horizon, Neutron, Heat, Cinder, and others. It
provides a simple way to add consistency and repeatability to running
tests w/ minimal human effort, just run ./run_tests.sh.

Change-Id: I5469cdeacb933d30868596e5bb9e767b17ab44d2
Shorten swift-internal:// to swift://

The internal/external distinction can be handled with meta-data
instead of encoding it within the url. So we can simply start using
swift://.

This patch keeps the swift-internal:// option around until we decide
it can simply be removed.

Change-Id: I5ea3d93319daf426539abc78ae826b6594035df9
Implements: blueprint swift-url-proto-cleanup
Delete 'links' only if it is present

This was uncovered during some mock testing where 'links' was not
always present.

Change-Id: I72c6ce9414394b1999c2925665c5bd74713d2d7f
Fix how migration's cli register db connection opt

It's not good to duplicate the same oslo.config options in one project
due to the fact that it'll be hadled incorrectly by different config
sample generation tools. The better option is to use CONF.import_opt
that will import oslo/db/sqla/session that already registers db connection
option with good description and backward compatibility support.

Change-Id: I71c4c0442464f2b4e88fb172f5d5e23daa133834