Text Generation
Transformers
GGUF
English
llama
sft
text-generation-inference

issues with downloading

#1
by Daria - opened

Hi team! Thank you so much for your great work) Want to download some meduim size version and faced with issues:

  1. if i try to downdload via wget - wget https://huggingface.co/TheBloke/OpenAssistant-Llama2-13B-Orca-8K-3319-GGUF/blob/main/openassistant-llama2-13b-orca-8k-3319.Q4_K_M.gguf - size of file are very small
    image.png
    and I cannot use it

image.png

image.png

  1. if i try to download via huggingface-cli - strange error
    image.png

want to use model with langchain so did not download llama.cpp
So please kind you be so kind to let me know where is my mistake

small update:
try to do the same on another VM and issues are changed

  1. via huggingface-cli - issues with url Entry Not Found for url: https://huggingface.co/TheBloke/OpenAssistant-Llama2-13B-Orca-8K-3319-GGUF/resolve/main/openassistant-llama2-13b-orca-8k-3319.q5_K_M.gguf.
    checked several models

image.png
2) via wget - realized that used not correct link, find another
image.png
and everything is FINE!!!!

so actually do not understand what is not correct with huggingface-cli, but simple download with link is ok))

Sign up or log in to comment