Allow running setup without numpy installed