Actually limit virtualenv to python files.