The problem we are trying to solve is to be able to wipe out the workspace and create a new virtualenv for each build so we know it's clean. But numpy and scipy take too long. Since we rarely change versions for these packages, we can mitigate this by installing them once at the system level.