Don't reset group filters if not necessary. Fixes #460