You don't need to install Python modules in the virtualenv you are in.  See the footnote I added recently in: https://github.com/tkf/emacs-jedi#manual-install

You *can* install modules in the virtualenv you are in, but it makes it harder to switching virtualenv when using Jedi.el.