Allow to disable norms on an existing field.

Close #4813