.travis.yml: only use wheels for numpy

Don't try to use wheel for PyOpenCL, etc. because the build becomes too brittle.