hexfp: Fix zero in IEEE 754 quadruples, cleanups, safety.

Cleanups: define auxiliary symbols depending on what kind of
long doubles we have, making the code itself somewhat less noisy.

Safety: for double-double the overflow checks were wrong since
the maximum number of bits (and therefore result) is much larger.