Do a raw git fetch instead of having GitPython do it for us