Fix test failures from warnings

* Some machines print warnings to stderr from plugins
* We can't silence these warnings and the tests fail
* Tests now look for a specific string instead of any output