Removing numpy from build script