Fix for #5836 (--lock-many with vms)

This makes --lock-many work when --machine-type vps is passed.
Before it wasn't handled correctly and guests were not created.
Now it creates and gives the back the user the list-targets for
said guests.

teuthology-lock --lock-many 4 --machine-type vps --os-type centos

This fixes issue #5836

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
Reviewed-by: Alfredo Deza <alfredo@deza.pe>
rgw_sync_agent: add new rgw_sync_agent task

This pulls access data out of the rgw task and off disk,
and then downloads, sets up, and runs an rgw sync agent
in test mode.

Signed-off-by: Greg Farnum <greg@inktank.com>
rgw: ignore exit status when removing base apache dir

subdirs have already been removed, and this only needs to succeed once
per host.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
rgw_sync_agent: fix a bunch of issues

- Read ceph.conf from stored copy that includes overrides
- Get system users and keys from cluster instead of reading other
  tasks' yaml, which may not be complete.
- Put zone info extraction from the cluster into utility functions,
  since it'll be useful for other tests later.
- Work with more than one agent on a single host
- Accept more than one client to run, like almost every other task
- Rename target to dest for consistency with radosgw-agent
- Don't make everything one large function

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
radosgw-agent: rename task to match tool name

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
rgy.py: make log_(data|metadata) configurable

The log_data and log_metadata are made configurable
via the YAML file and default to false
(meaning neither data nor metadata operations are
logged).

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
rgw: create system users with the --system flag

without this they have no special permissions

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
rgw: don't make domain_root pool the same as zone root

These are supposed to be separate pools.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
radosgw-agent: move zone extraction to helper

This will be useful for other tasks.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
radosgw-agent: get verbose logs from the agent

This makes it a lot easier to debug.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
rgw: add log settings to example config

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
rgw.py: adding a safety check

Correcting a bug where specifying
a rgw server for a client but not specifying
a system user would throw an exception.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
rgw: do not ignore leaks

Signed-off-by: Sage Weil <sage@inktank.com>
rgw.py: add None object check when parsing info

The rgw task was failing to check for a None object
when parsing user info in the case where there were
config options set for the client that did not include
user info (e.g. valgrind: ).
samba: wait for smbd process to exit

I saw

2013-08-03T12:56:26.641 DEBUG:teuthology.orchestra.run:Running [10.214.131.28]: 'sudo killall -9 smbd'
2013-08-03T12:56:26.727 DEBUG:teuthology.orchestra.run:Running [10.214.131.28]: 'sudo lsof /home/ubuntu/cephtest/93695/mnt.0'
2013-08-03T12:56:26.830 INFO:teuthology.orchestra.run.out:[10.214.131.28]: COMMAND   PID USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
2013-08-03T12:56:26.830 INFO:teuthology.orchestra.run.out:[10.214.131.28]: smbd    12381 root  cwd    DIR    0,0        0    1 /home/ubuntu/cephtest/93695/mnt.0

which makes me think we just need to wait a moment before
attempting the umount?

Signed-off-by: Sage Weil <sage@inktank.com>
Merge remote-tracking branch 'gh/next'
s3readwrite.py: enable overrides

Enable s3readwrite task to have the branch to
download specified and for overrides to be
incorporated into the config at run-time.
Code based on the s3tests.py task.

Signed-off-by: Joe Buck <jbbuck@gmail.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Add a useful error message in case of an invalid hostname
add a key for ceph-deploy-branch detection

Signed-off-by: Alfredo Deza <alfredo@deza.pe>
Merge remote-tracking branch 'gh/next'