Correct numerical precision problems in doc test