Make the Duration::span() test slightly less flakiness-prone