Allow fpe off

Adds test to #3614.