Disallow changing settings on immutable face

Ouch!