ImportError
#27
by
kris-123
- opened
Following is the error trying to run zephyr-7b-alpha using HuggingFaceLLM method in llama_index.llms locally:
ImportError: Using load_in_8bit=True requires Accelerate: pip install accelerate and the latest version of bitsandbytes pip install -i https://test.pypi.org/simple/ bitsandbytes or pip install bitsandbytes
Libraries installed already:
transformers
accelerate
bistandbytes
kris-123
changed discussion status to
closed