second-state
/

Samantha-1.11-CodeLlama-34B-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions Community

apepkuss79 commited on Feb 24

Commit

962da82

•

1 Parent(s): cc37729

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -47,13 +47,13 @@ quantized_by: Second State Inc.
 - Run as LlamaEdge service
   ```bash
-  wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-Q5_K_M.gguf llama-api-server.wasm -p vicuna-chat -s 'You are a helpful AI assistant.'
   ```
 - Run as LlamaEdge command app
   ```bash
-  wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-Q5_K_M.gguf llama-chat.wasm -p vicuna-chat -s 'You are a helpful AI assistant.'
   ```
 ## Quantized GGUF Models

 - Run as LlamaEdge service
   ```bash
+  wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-Q5_K_M.gguf llama-api-server.wasm -p vicuna-1.0-chat -s 'You are a helpful AI assistant.'
   ```
 - Run as LlamaEdge command app
   ```bash
+  wasmedge --dir .:. --nn-preload default:GGML:AUTO:Samantha-1.11-CodeLlama-34b-Q5_K_M.gguf llama-chat.wasm -p vicuna-1.0-chat -s 'You are a helpful AI assistant.'
   ```
 ## Quantized GGUF Models