Felladrin
/

gguf-TinyMistral-248M-Chat-v2

Inference Endpoints

Model card Files Files and versions Community

Felladrin commited on Apr 20

Commit

a93465d

•

1 Parent(s): ca36310

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -14,8 +14,9 @@ brew install ggerganov/ggerganov/llama.cpp
 llama-cli \
   --hf-repo Felladrin/gguf-TinyMistral-248M-Chat-v2 \
   --model TinyMistral-248M-Chat-v2.Q8_0.gguf \
-  --random-prompt  \
-  --dynatemp-range "0.1-2.5" \
   --top-k 0 \
   --top-p 1 \
   --min-p 0.1 \

 llama-cli \
   --hf-repo Felladrin/gguf-TinyMistral-248M-Chat-v2 \
   --model TinyMistral-248M-Chat-v2.Q8_0.gguf \
+  --random-prompt \
+  --temp 1.3 \
+  --dynatemp-range 1.2 \
   --top-k 0 \
   --top-p 1 \
   --min-p 0.1 \