Installing the python3-numpy system package alone did not do the trick on Python 3 for some reason (why this works on Python 2 I'm not even sure).  This *might* do the trick though, by symlinking the system package into the virtualenv's site-packages.