Error when deploying endpoint on Sagemaker

#2
by josecordero - opened

Hi,
I'm trying to deploy this model as an endpoint following the instructions provided and this error is happening every time:

#033[2m2023-09-08T10:20:33.973714Z#033[0m #033[31mERROR#033[0m #033[1mdownload#033[0m: #033[2mtext_generation_launcher#033[0m#033[2m:#033[0m Download encountered an error: Traceback (most recent call last):
  File "/opt/conda/lib/python3.9/site-packages/text_generation_server/utils/hub.py", line 96, in weight_files
    filenames = weight_hub_files(model_id, revision, extension)
  File "/opt/conda/lib/python3.9/site-packages/text_generation_server/utils/hub.py", line 37, in weight_hub_files
    raise EntryNotFoundError(

huggingface_hub.utils._errors.EntryNotFoundError: No .safetensors weights found for model TheBloke/Yarn-Llama-2-13B-64K-GGUF and revision None.

Any clue about how to solve it?

Thanks in advance.

Sign up or log in to comment