Upgrade backoff to 1.0.4

As this actually supports python 3.

This should fix [#83057422]