FIX setup.py numpy-awareness

XXX [@larsmans]: I screwed up this commit by @kmike,
so cherry-picking it again.