We should make this filterable by being able to pass the path to the test file rather than the regex kludge we have now.

Rather than all the custom stuff we have here, can we make our tests just regular add-ons or something?