Fix pip requirements caching issue

This fixes #4293.