Remove modifiers which no longer exist