Errors: Support a filter to control which errors are reported

Fixes #335
Hmm. Why is this passed in as a constructor arg and not loaded in with other config options? Or am I missing something?