Remove CastExp::disableOptimization.

Seems like our glue code handles the type adaption just fine now.