Drop NumPy requirement to enable faster builds