Errors: Support a filter to control which errors are reported

Fixes #335
Yeah, we should!