Don't use column object when calculating type cast defaults

Moves towards removing type casting knowledge from the column entirely