Don't cast non-numbers to numbers in NumberTransformer