>> does the build fail if the required package, say pytest-xdist, is missing from $NUPIC/external/common/pip-cache?
> yes. it will fail... 

Is this what we want? I like having cached downloads/build w/o internet connection, but imagine a user adds a dependency. Now he needs to download the tarball and put into pip-cache....