second-state
/

Hermes-2-Pro-Llama-3-8B-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions Community

apepkuss79 commited on May 8

Commit

2c8ba0c

•

1 Parent(s): 456ef4a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -60,7 +60,7 @@ language:
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:Hermes-2-Pro-Llama-3-8B-Q5_K_M.gguf \
     llama-chat.wasm \
     --prompt-template chatml \
-    --ctx-size 4096 \
   ```
 ## Quantized GGUF Models

   wasmedge --dir .:. --nn-preload default:GGML:AUTO:Hermes-2-Pro-Llama-3-8B-Q5_K_M.gguf \
     llama-chat.wasm \
     --prompt-template chatml \
+    --ctx-size 4096
   ```
 ## Quantized GGUF Models