Remove workaround for 32-bit msvc fenv_access bug

Putting this up to trigger appveyor build which should show the issue.