Failed to import - PackageNotFoundError: No package metadata was found for bitsandbytes

#1
by FelipeCasali-USP - opened

Could you please help to address this issue when running this model locally?

Jypter Notebook in Visual Studio
Python 10 and 11

you need to install bitsandbytes:

pip install bitsandbytes

Ashishkr changed discussion status to closed

I imported the bitsandbytes, but it seems I don't have permission to load this project.
I'm logged in HF with my token.

OSError: You are trying to access a gated repo.
Make sure to request access at https://huggingface.co/meta-llama/Llama-2-7b-hf and pass a token having permission to this repo either by logging in with huggingface-cli login or by passing token=<your_token>.

hf_auth = "hf_your-huggingface-access-token"

you need to provide your hf access token here.

Sign up or log in to comment