Well, that's a whole 'nother issue, isn't it? When the tests should be run. You are correct that the purpose of the unit tests are not to catch gaia, or gecko, regressions, but rather to catch gaia_test regressions. They are needed when the methods being tested are being updated. Personally, I like to have unit tests for any methods that I add to gaia_test, but I understand that if we did that and ran them all the time that would add a lot of time to the test run.

In this case I'd be happy to keep just one test that runs from outside of an app and one that runs from within an app.

How's that for a compromise?