https://github.com/mozilla/mozbase/blob/master/manifestdestiny/manifestparser/manifestparser.py#l723

Has that file been adjusted since then? Anyhow, TestManifest checks the tests and ignores the one that do not exist. TestManifest.activetests() returns a list of all active tests. At least that is how I understand it.