Fix installing non default packages on virtualenvs with system site packages

Fixes travis-ci/travis-ci#2233