help plz: run with llama.cpp get failed to load model llama_init_from_gpt_params.

#2
by wukongai - opened

llamacpp -t 30 --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -ins -m wizardcoder-guanaco-15b-v1.1.ggmlv1.q8_0.bin
main: build = 874 (7d5f184)
main: seed = 1690290355
llama.cpp: loading model from wizardcoder-guanaco-15b-v1.1.ggmlv1.q8_0.bin
error loading model: unexpectedly reached end of file
llama_load_model_from_file: failed to load model
llama_init_from_gpt_params: error: failed to load model 'wizardcoder-guanaco-15b-v1.1.ggmlv1.q8_0.bin'
main: error: unable to load model

sorry , should be following log:

llamacpp -t 30 --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -ins -m starcoderplus-guanaco-gpt4.ggmlv1.q8_0.bin
main: build = 874 (7d5f184)
main: seed = 1690290255
llama.cpp: loading model from starcoderplus-guanaco-gpt4.ggmlv1.q8_0.bin
error loading model: unexpectedly reached end of file
llama_load_model_from_file: failed to load model
llama_init_from_gpt_params: error: failed to load model 'starcoderplus-guanaco-gpt4.ggmlv1.q8_0.bin'
main: error: unable to load model

checksum is ok:

sha256sum code.bin
3bfdde943555c78294626a6ccd40184162d066d39774bd2c98dae24943d32cc3 llama-2-7b-chat-codeCherryPop.ggmlv3.q8_0.bin
3c28134f812c3bfe731ceacf57a275edeb193bf9d05912138952735d69c1474e starcoderplus-guanaco-gpt4.ggmlv1.q8_0.bin
cc35cfac864f3439ea9d32df32b252f11f5a25e99ffe4431f4f278cf0d4d5448 wizardcoder-guanaco-15b-v1.1.ggmlv1.q8_0.bin

sorry, i kown that should use ctransformers to play with it.

wukongai changed discussion status to closed

Sign up or log in to comment