Hopefully fix CI by improving multi-suite runner.