Remove unwanted expansion key

For a given language, remove unwanted key from config that
we discarded because of the language choice.