second-state
/

CodeLlama-13B-Instruct-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions Community

apepkuss79 commited on Feb 23

Commit

a15909a

•

1 Parent(s): bd83925

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -46,7 +46,7 @@ quantized_by: Second State Inc.
 - Run as LlamaEdge command app
   ```bash
-  wasmedge --dir .:. --nn-preload default:GGML:AUTO:codellama-13b-instruct.Q4_0.gguf llama-chat.wasm -p codellama-instruct
   ```
 ## Quantized GGUF Models

 - Run as LlamaEdge command app
   ```bash
+  wasmedge --dir .:. --nn-preload default:GGML:AUTO:CodeLlama-13b-Instruct-hf-Q5_K_M.gguf llama-chat.wasm -p codellama-instruct
   ```
 ## Quantized GGUF Models