Re-working how tox venvs work

Signed-off-by: Daniel Farrell <dfarrell@redhat.com>