Get a Segementation fault when loading the model
#2
by
Kalamia
- opened
Hello, i wanted to test your model but i get a segmentation fault error when i try to launch it.
~/llama.cpp $ ./main -t 4 -m models/LLaMA-2-7B-32K-Instruct-Q5_K_S.gguf --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -b 10 -n -1 -i -ins
main: build = 1085 (1591e2e)
main: seed = 1693477317
Segmentation fault
it seems that llama.cpp produces segfaults under certain conditions (independently of the model)
I would recommend that you look through the open llama.cpp issues and add yourself to those that fit best. One that I am involved with (albeit just a bit) is issue #2893