Hugging Face's logo

Bitsandbytes documentation

Installation

You are viewing v0.42.0 version. A newer version v0.45.4 is available.
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Installation

Note currently bitsandbytes is only supported on CUDA GPU hardwares, support for AMD GPUs and M1 chips (MacOS) is coming soon.

Linux
Windows

Linux

From Pypi

pip install bitsandbytes

From source

git clone https://github.com/TimDettmers/bitsandbytes.git && cd bitsandbytes/
CUDA_VERSION=XXX make cuda12x
python setup.py install

with XXX being your CUDA version, for <12.0 call make cuda 11x

←Quickstart