Add a notest option, in a terrible way that needs refactoring.