Test plugin output and treat errors as failures
remove unnecessary files
simplify
test case for syntax error
Merge branch 'fix-silence-on-error'