unsloth

/

llama-3-8b-bnb-4bit

like 115

Did you try installing it separately ie:

pip install bitsandbytes
python -m bitsandbytes

I am receiving an error when running it in the Space.Runtime error
le "/usr/local/lib/python3.11/site-packages/huggingface_hub/utils/_errors.py", line 296, in hf_raise_for_status
raise EntryNotFoundError(message, response) from e
huggingface_hub.utils._errors.EntryNotFoundError: 404 Client Error. (Request ID: Root=1-663f5d4d-6d1499bb2d614c586741208f;2e1f967c-7532-4c12-a118-cb6ad92719ce)

Entry Not Found for url: https://huggingface.co/unsloth/llama-3-8b-bnb-4bit/resolve/7655c28aeb7c18c7dba8b1f5f2e3b276b163e59c/config.json.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/src/transformers/src/transformers/pipelines/base.py", line 279, in infer_framework_load_model
model = model_class.from_pretrained(model, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/src/transformers/src/transformers/modeling_utils.py", line 2983, in from_pretrained
config, model_kwargs = cls.config_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/src/transformers/src/transformers/configuration_utils.py", line 602, in from_pretrained
config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/src/transformers/src/transformers/configuration_utils.py", line 631, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/src/transformers/src/transformers/configuration_utils.py", line 686, in _get_config_dict
resolved_config_file = cached_file(
^^^^^^^^^^^^
File "/src/transformers/src/transformers/utils/hub.py", line 452, in cached_file
raise EnvironmentError(
OSError: unsloth/llama-3-8b-bnb-4bit does not appear to have a file named config.json. Checkout 'https://huggingface.co/unsloth/llama-3-8b-bnb-4bit/7655c28aeb7c18c7dba8b1f5f2e3b276b163e59c' for available files.