Try to use fetch the numpy include dir late in setup.py (it might not be installed when setup.py is run)