rados.py: Add pool_snaps option for ceph_test_rados test command

Fixes: #8284

Signed-off-by: David Zafman <david.zafman@inktank.com>
Use longer varchar for locked_by in DB.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
Revert "Restrict paramiko to old versions for now"

This reverts commit c86df77aa68dc5331b98df3fa038faee77c578ad.
Revert "Revert "Handle raw data I/O.""

This reverts commit 0c8a3e2334631f5fc20cb7933d0005353ea6a46e.
Revert "Revert "Clean up remote.py and misc.py changes.""

This reverts commit 02504c3fd27d788e2e446369015b14cbf259a8d2.
Use SFTPClienti get for long reads/writes

Modified remote.py to use the paramiko SFTPClient get
method to extract long files (mostly tar files) from
the remote host.  The code formerly saved the data
in a long local string which was very inefficient.

Fixes: 8261
Signed-off-by: Warren Usui <warren.usui@inktank.com>
FIx mktemp dir and redundant Paramiko connecting.

Use previously initialized connection for sftp_get calls.
Use local directory for tarball temp file location.
Fix linter errors

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
Rewrite most file-retrieval functions

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
rbd_fsx: expose krbd and related fsx options

Expose

-K (enable krbd mode) through 'krbd',
-Z (use direct IO) through 'direct_io',
-U (disable randomized striping) through 'randomized_striping',
-H (disable discard ops) through 'punch_holes',

-r readbdy (read alignment) through 'readbdy',
-w writebdy (write alignment) through 'writebdy',
-h holebdy (discard alignment) through 'holebdy'.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
Merge pull request #249 from ceph/wip-8284

rados.py: Add pool_snaps option for ceph_test_rados test command
Merge pull request #252 from ceph/wip-fsx-krbd

rbd_fsx: expose krbd and related fsx options

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Further clarify 'too many values to unpack' error.

Many errors in yaml configurations cause ValueError to get thrown
with the message 'too many values to unpack.'  A previously reverted
change tried to handle all these situations and print an appropriate
message.

The current behavior of throwing the ValueError exception and exiting
is probably what we still want in these cases.  So instead of handling
the error, the code now checks for the exception at the top-most call
and displays appropriate messages in log.error and in the ctx.summary
data itself.

Fixes: 7510
Signed-off-by: Warren Usui <warren.usui@inktank.com>
Merge pull request #253 from ceph/wip-7510-wusui

Further clarify 'too many values to unpack' error.
Use master as default for debian upgrade.

Make sure that uri is defined for debian upgrades.
Use master as default.

Added _get_uri_() which consolidates checking and assignment of
sha1, tags, and branch values.

Fixes: 7707
Signed-off-by: Warren Usui <warren.usui@inktank.com>
Use binary flag for paramiko ChannelFiles

This works around http://tracker.ceph.com/issues/8313

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
Force log lines to be interpreted as UTF-8

Any invalid UTF-8 byte will be replaced with a Unicode replacement
character: U+FFFD or '�'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>
Merge pull request #254 from ceph/wip-7707-wusui

Use master as default for debian upgrade.
Allow .teuthology.yaml to set downburst path

If .teuthology.yaml defines downburst, _get_downburst_exec()
now returns that value as the path to the downburst executable.

Also cleaned up code in create_if_vm.  ctx.downburst_conf was
never defined, so the code that handled the AttributeError
was always being executed.

Fixes: 6921

Signed-off-by: Warren Usui <warren.usui@inktank.com>
Revert "Revert "Show hostname instead of IP in errors""

This reverts commit 10fee0e368750cf4cd953db5700df59c7f611119.

Conflicts:
	teuthology/orchestra/run.py