set constant tolerance for numerical errors