Implement a build matrix for travis to test with/without numpy

Don't know if this really works. Where can I see in the logs if numpy support is enabled or not?

By default no numpy package seems to be installed in travis. But with or without the package in the logs we always have `-DHAVE_NUMPY=1`