Added upgrade tests - stable

Signed-off-by: Yuri Weinstein <yuri.weinstein@inktank.com>
upgrade/firefly: consolidate into a single collection

Signed-off-by: Sage Weil <sage@inktank.com>
suites/upgrade/firefly: test rgw at the end

...and do all final tests for all runs

Signed-off-by: Sage Weil <sage@redhat.com>
upgrade/firefly: upgrade mds after osd

Signed-off-by: Sage Weil <sage@redhat.com>
upgrade/firefly: fix final steps

Signed-off-by: Sage Weil <sage@redhat.com>
upgrade/firefly: ignore crush tunables on upgrade

..then adjust them

Signed-off-by: Sage Weil <sage@redhat.com>
upgrade/firefly: upgrade to firefly, not dumpling

Signed-off-by: Sage Weil <sage@redhat.com>
upgrade/firefly: do intermediate s3tests on original test set

The later s3-tests fail on early firefly point releases.

Signed-off-by: Sage Weil <sage@redhat.com>
upgrade/firefly: ignore mon scrub errors from early firefly versions

See #8815

Signed-off-by: Sage Weil <sage@redhat.com>
upgrade/firefly: don't use overrides

Signed-off-by: Sage Weil <sage@redhat.com>
Merge branch 'wip_stable_upgrade2' into firefly