Cannot write to './llama.cpp/models/llama-2-70b-chat.ggmlv3.q2_K.bin'
#7
by
HoangHa
- opened
I tried to load the Llama-2-70B-chat-ggml model in Kaggle Notebook. The code works with 30B but I got an error with 70B: "Cannot write to './llama.cpp/models/llama-2-70b-chat.ggmlv3.q2_K.bin'". How can I fix this? Please help me.
The code to reproduce:
!cd ../input/
!git clone https://github.com/ggerganov/llama.cpp.git && cd llama.cpp && make LLAMA_CUBLAS=1
!wget https://huggingface.co/TheBloke/Llama-2-70B-Chat-GGML/resolve/main/llama-2-70b-chat.ggmlv3.q2_K.bin -P ./llama.cpp/models/
I think you are already in ./llama.cpp
Try this instead:
!wget https://huggingface.co/TheBloke/Llama-2-70B-Chat-GGML/resolve/main/llama-2-70b-chat.ggmlv3.q2_K.bin -P ./models/