Fail if plugin does not compile.

Test against multiple jvms.