Consistently only warn on bad FPU state

For reals this time