Adding an `assert_greater_equal` and `assert_less_equal`in sklearn.utils.testing would be a good option.