Error when deploying endpoint on Sagemaker
#2
by
josecordero
- opened
Hi,
I'm trying to deploy this model as an endpoint following the instructions provided and this error is happening every time:
#033[2m2023-09-08T10:20:33.973714Z#033[0m #033[31mERROR#033[0m #033[1mdownload#033[0m: #033[2mtext_generation_launcher#033[0m#033[2m:#033[0m Download encountered an error: Traceback (most recent call last):
File "/opt/conda/lib/python3.9/site-packages/text_generation_server/utils/hub.py", line 96, in weight_files
filenames = weight_hub_files(model_id, revision, extension)
File "/opt/conda/lib/python3.9/site-packages/text_generation_server/utils/hub.py", line 37, in weight_hub_files
raise EntryNotFoundError(
huggingface_hub.utils._errors.EntryNotFoundError: No .safetensors weights found for model TheBloke/Yarn-Llama-2-13B-64K-GGUF and revision None.
Any clue about how to solve it?
Thanks in advance.