More cleaning. Remove one unused class, which also allows removing the
FieldDef from Column (where it is no longer used).