Simplify float conversion code

Since our non-IEEE mode doesn't use DAZ anymore, we don't need to care
about denormals anymore when converting single->double.
Suggestions by @FioraAeterna
Merge pull request #2 from Tilka/simplify_float_conversions

Simplify float conversions