BUG: ifort has issues with optimization flag -O2

Fixes several hard to track scipy test failures. See https://github.com/scipy/scipy/issues/3306, https://github.com/scipy/scipy/issues/3340, and https://github.com/scipy/scipy/issues/1205