But that's part of the purpose of the tests, they should break and signal that something gets worse.

It's still possible to adjust the precision then, but only intentionally after seeing the problem.
It's quite common to have to adjust the precision in scipy or statsmodels, when the tests are run for the first time on new machines, compilers, ...