Prevent InlineColorEditor's own changes from changing input values

For #8572.