flexible SuiteRunner for testing
don't print out ignores when not ignoring