Test: add test case verifying that dynamically enabling/disabling merge IO throttling works

For #6626
can we try turning those into constants? I think we should try doing this all the time though.