rounded floating point error in array test