Implement flash_helper to remove unwanted keys from flash. Fixes #3316

This isn't a setting that's regularly going to be used, so I don't think it should be included in the initializer.