jsfs11 commited on
Commit
1a44245
1 Parent(s): 64393d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -6,7 +6,7 @@ tags:
6
  - gguf-my-repo
7
  ---
8
 
9
- # jsfs11/WestOrcaMonarch-DPO-7B-Q8_0-GGUF
10
  This model was converted to GGUF format from [`jsfs11/WestOrcaMonarch-DPO-7B`](https://huggingface.co/jsfs11/WestOrcaMonarch-DPO-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
11
  Refer to the [original model card](https://huggingface.co/jsfs11/WestOrcaMonarch-DPO-7B) for more details on the model.
12
  ## Use with llama.cpp
@@ -17,16 +17,16 @@ brew install ggerganov/ggerganov/llama.cpp
17
  Invoke the llama.cpp server or the CLI.
18
  CLI:
19
  ```bash
20
- llama-cli --hf-repo jsfs11/WestOrcaMonarch-DPO-7B-Q8_0-GGUF --model westorcamonarch-dpo-7b-q8_0.gguf -p "The meaning to life and the universe is"
21
  ```
22
  Server:
23
  ```bash
24
- llama-server --hf-repo jsfs11/WestOrcaMonarch-DPO-7B-Q8_0-GGUF --model westorcamonarch-dpo-7b-q8_0.gguf -c 2048
25
  ```
26
  Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
27
  ```
28
  git clone https://github.com/ggerganov/llama.cpp && \
29
  cd llama.cpp && \
30
  make && \
31
- ./main -m westorcamonarch-dpo-7b-q8_0.gguf -n 128
32
  ```
 
6
  - gguf-my-repo
7
  ---
8
 
9
+ # jsfs11/WestOrcaMonarch-DPO-7B-GGUF
10
  This model was converted to GGUF format from [`jsfs11/WestOrcaMonarch-DPO-7B`](https://huggingface.co/jsfs11/WestOrcaMonarch-DPO-7B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
11
  Refer to the [original model card](https://huggingface.co/jsfs11/WestOrcaMonarch-DPO-7B) for more details on the model.
12
  ## Use with llama.cpp
 
17
  Invoke the llama.cpp server or the CLI.
18
  CLI:
19
  ```bash
20
+ llama-cli --hf-repo jsfs11/WestOrcaMonarch-DPO-7B-Q8_0-GGUF --model westorcamonarch-dpo-7b.gguf -p "The meaning to life and the universe is"
21
  ```
22
  Server:
23
  ```bash
24
+ llama-server --hf-repo jsfs11/WestOrcaMonarch-DPO-7B-Q8_0-GGUF --model westorcamonarch-dpo-7b.gguf -c 2048
25
  ```
26
  Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
27
  ```
28
  git clone https://github.com/ggerganov/llama.cpp && \
29
  cd llama.cpp && \
30
  make && \
31
+ ./main -m westorcamonarch-dpo-7b.gguf -n 128
32
  ```