compute floating point