Well, I wouldn't say it is always a bad idea. It can even resemble the real usage pattern much more closely in many cases, allowing you to catch bugs you wouldn't catch otherwise. And you can always reproduce the same spec run by providing RSpec with the same seed if you need to.

But in this case it might not be the perfect fit, I agree.