Remove code that disables optimizations when the compiler is clang.

I don't have this issue and it has no effect at runtime.