Don't ignore charset in fuzzy header

Because msgmerge doesn't ignore it.

This change reverts the recent commit.