Clean up a bit more thoroughly when building the package
Depend on virtualenv instead of python-virtualenv

Closes GH-41 and Debian#751192