rbd/rgw upgrade suites to test upgrade from bobtail to cuttlefish to next

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>
kernel: reorg kernel rbd tests; add a few missing scripts

Move all the simple workunits into a separate collection, and test with
and without msgr failure injection.

There were a few tests in the workunits dir that we weren't running.
marginal: restructure the multimds collection

- two clients types (ceph-fuse and kclient)
- two clients in each test
- separate out tasks
kernel: add rbd test to write a 1TB image

Motivated by #5454
upgrade: move fs upgrade tests to a separate suite

For now.. until we figure out why they keep failing!
big: thrash, and whitelist wrongly marked me down
big: timebox test to two hours
kernel: add instal, ceph tasks to rbd-nomount collection
rgw: move radosgw-admin test into rgw suite
upgrade: ignore mds restart order on rbd, rados tests

Not relevant to rbd; put these in the fs upgrade matrix.
kernel: specify fs (and use raw disks) for rbd-nomount tests

Otherwise simple 1tb test fills up the root disks.  :(
rbd: remove kernel rbd test from rbd suite

It's already present in the kernel suite.
upgrade/rgw-double: start rgw
upgrade/rgw: mds restart order doesn't matter
upgrade/rgw: use bobtail s3tests
kernel: test o_trunc

Signed-off-by: Sage Weil <sage@inktank.com>
fs: add o_trunc test on ceph-fuse

Signed-off-by: Sage Weil <sage@inktank.com>
rbd: reeanble iozone test, just to see

See #2689
test_o_trunc.sh moved
kernel: simple_1tb -> simple_big

1TB is too big for plana