Don't remove selection when a selected char becomes dirty. That code survived from the old iTerm a million years ago and I can't scrute the benefit; it was responsible for bug 2886. If there's a great hue and cry then this can come back.