rados: expand mon thrashing tests

- test sync (full and recent)
- test multiple mons down
- test other cluster sizes (3 and 9)

Signed-off-by: Sage Weil <sage@inktank.com>
rados/monthrash: refactor a bit

Signed-off-by: Sage Weil <sage@inktank.com>
rados/monthrash: reduce matrix size a bit

we don't need so many osd workloads
rados/mon_thrash: inject random delays in mon messages

More useful than osd delays for this collection
restart rgw after upgrade for rgw tests

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
Added task yaml for partial-upgrade of osds

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
added upgrade task for mixed mon test

Signed-off-by: tamil <tamil@tamil-VirtualBox.(none)>