Package: blis
Cython BLIS: Fast BLAS-like operations from Python and Cython, without the tearsThis repository provides theBlis linear algebraroutines as a self-contained Python C-extension.Currently, we only supports single-threaded execution, as this is actually best for our workloads (ML inference).InstallationYou can install the package via pip, first making sure thatpip,setuptools,
andwheelare up-to-date:pipinstall-Upipsetuptoolswheel
pipinstallblisWheels should be available, so installation should be fast. If you want to install from source and you're on Windows, you'll need to install LLVM.Building BLIS for alternative architecturesThe provided wheels should work on x86_64 and osx/arm64 architectures. Unfortunately we do not currently know a way to provide different wheels for alternative architectures, and we cannot provide a single binary that works everywhere. So if the wheel doesn't work for your CPU, you'll need to specify source distribution, and tell Blis your CPU architecture using theBLIS_ARCHenvironment variable.a) Install with auto-detected CPU supportpipinstallspacy--no-binaryblisb) Install using an existing configurationProvide an architecture from thesupported configurations.BLIS_ARCH="power9"pipinstallspacy--no-binaryblisc) Install with generic arch support⚠️genericis not optimized for any particular CPU and is extremely slow. Only recommended for testing!BLIS_ARCH="generic"pipinstallspacy--no-binaryblisd) Build specific supportIn order to compile Blis,cython-blisbundles makefile scripts for specific architectures, that are compiled by running the Blis build system and logging the commands. We do not yet have logs for every architecture, as there are some architectures we have not had access to.See herefor list of
architectures. For example, here's how to build support for the Intel architectureknl:gitclonehttps://github.com/explosion/cython-blis&&cdcython-blis
gitpull&&gitsubmoduleinit&&gitsubmoduleupdate&&gitsubmodulestatus
python3-mvenvvenvsourcevenv/bin/activate
pipinstall-Upipsetuptoolswheel
pipinstall-rrequirements.txt
./bin/generate-make-jsonllinuxknlBLIS_ARCH="knl"pythonsetup.pybuild_ext--inplaceBLIS_ARCH="knl"pythonsetup.pybdist_wheelFingers crossed, this will build you a wheel that supports your platform. You
could thensubmit a PRwith
theblis/_src/make/linux-knl.jsonlandblis/_src/include/linux-knl/blis.hfiles so that you can run:BLIS_ARCH="knl"pipinstall--no-binary=blisUsageTwo APIs are provided: a high-level Python API, and directCythonaccess, which provides fused-type, nogil
Cython bindings to the underlying Blis linear algebra library. Fused
types are a simple template mechanism, allowing just a touch of
compile-time generic programming:cimportblis.cyA=<float*>calloc(nN*nI,sizeof(float))B=<float*>calloc(nO*nI,sizeof(float))C=<float*>calloc(nr_b0*nr_b1,sizeof(float))blis.cy.gemm(blis.cy.NO_TRANSPOSE,blis.cy.NO_TRANSPOSE,nO,nI,nN,1.0,A,nI,1,B,nO,1,1.0,C,nO,1)Bindings have been added as we've needed them. Please submit pull requests if
the library is missing some functions you require.DevelopmentTo build the source package, you should run the following command:./bin/update-vendored-sourceThis populates theblis/_srcfolder for the various architectures, using theflame-blissubmodule.Updating the build filesIn order to compile the Blis sources, we use jsonl files that provide the
explicit compiler flags. We build these jsonl files by running Blis's build
system, and then converting the log. This avoids us having to replicate the
build system within Python: we just use the jsonl to make a bunch of subprocess
calls. To support a new OS/architecture combination, we have to provide the
jsonl file and the header.LinuxThe Linux build files need to be produced from within the manylinux2014
Docker container, so that they will be compatible with the wheel building
process.First, install docker. Then do the following to start the container:sudo docker run -it quay.io/pypa/manylinux2014_x86_64:latestOnce within the container, the following commands should check out the repo and
build the jsonl files for the generic arch:mkdir /usr/local/repos
cd /usr/local/repos
git clone https://github.com/explosion/cython-blis && cd cython-blis
git pull && git submodule init && git submodule update && git submodule
status
/opt/python/cp36-cp36m/bin/python -m venv env3.6
source env3.6/bin/activate
pip install -r requirements.txt
./bin/generate-make-jsonl linux generic --export
BLIS_ARCH=generic python setup.py build_ext --inplace
# N.B.: don't copy to /tmp, docker cp doesn't work from there.
cp blis/_src/include/linux-generic/blis.h /linux-generic-blis.h
cp blis/_src/make/linux-generic.jsonl /Then from a new terminal, retrieve the two files we need out of the container:sudo docker ps -l # Get the container ID
# When I'm in Vagrant, I need to go via cat -- but then I end up with dummy
# lines at the top and bottom. Sigh. If you don't have that problem and
# sudo docker cp just works, just copy the file.
sudo docker cp aa9d42588791:/linux-generic-blis.h - | cat > linux-generic-blis.h
sudo docker cp aa9d42588791:/linux-generic.jsonl - | cat > linux-generic.jsonl