Errors: Support a filter to control which errors are reported

Fixes #335
We probably need to add some smoke tests for browser version, like with phantom, not sure if would need something more besides that