danielus commited on
Commit
71e340c
1 Parent(s): 1b06080

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-sa-4.0
3
+ tags:
4
+ - llama-cpp
5
+ ---
6
+
7
+ # danielus/MermaidSolar-Q4_K_S-GGUF
8
+ This model was converted to GGUF format from [`TroyDoesAI/MermaidSolar`](https://huggingface.co/TroyDoesAI/MermaidSolar) using llama.cpp.
9
+ Refer to the [original model card](https://huggingface.co/TroyDoesAI/MermaidSolar) for more details on the model.
10
+ ## Use with llama.cpp
11
+
12
+ ```bash
13
+ brew install ggerganov/ggerganov/llama.cpp
14
+ ```
15
+
16
+ ```bash
17
+ llama-cli --hf-repo danielus/MermaidSolar-Q4_K_S-GGUF --model mermaidsolar.Q4_K_S.gguf -p "The meaning to life and the universe is "
18
+ ```
19
+
20
+ ```bash
21
+ llama-server --hf-repo danielus/MermaidSolar-Q4_K_S-GGUF --model mermaidsolar.Q4_K_S.gguf -c 2048
22
+ ```