It will, yes, sadly. I'd love to give a try using factory_boy instead of this, we have some work started with @vinyll : https://github.com/vinyll/zamboni-factory (very beta for the moment, and misses quite a lot of factories, but it could really help with this).

Another option would have been to disconnect the "faulty" signal, but I'm afraid this could "cover" tests that should fail, or tests that assume the check is run.