Simplify float conversion code

Since our non-IEEE mode doesn't use DAZ anymore, we don't need to care
about denormals anymore when converting single->double.