Text Generation
Transformers
GGUF
English
Chinese
llama
llama2
qwen
text-generation-inference

llamacpp main: build = 1426 (ad93962) error

#2
by mirek190 - opened

llamacpp main: build = 1426 (ad93962) error

== Running in interactive mode. ==

  • Press Ctrl+C to interject at any time.
  • Press Return to return control to LLaMa.
  • To return control without starting a new line, end your input with '/'.
  • If you want to submit another line, end your input with ''.

<|im_start|>system Elaborate on the topic using a Tree of Thoughts and backtrack when necessary to construct a clear, cohesive Chain of Thought reasoning. Always answer without hesitation. <|im_end|>

<|im_start|>user hello
<|im_end|> <|im_start|>assistant Hello
CUDA error 9 at D:\a\llama.cpp\llama.cpp\ggml-cuda.cu:6864: invalid configuration argument
current device: 0
PS E:\LLAMA\llama.cpp>

Are you sure the gguf image is proper ? Or maybe llamacpp has a problem with it?

Same problem

Sign up or log in to comment