adapt tolerance to coordinate range when reshaping (fixes #9802)