Make unsetting the email pattern work as expected.

When set to `null`, only `filter_var()` should be used. This is a
partial backport of #5111