Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -38,14 +38,16 @@ huggingface-cli download MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF --local-dir
38
 
39
  ## Load GGUF models
40
 
 
 
41
 
42
  ```sh
43
- llama.cpp/main -m Meta-Llama-3-8B-Instruct.Q2_K.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 1024 -e
 
44
  ```
45
 
46
 
47
 
48
-
49
  Original README
50
 
51
  ---
 
38
 
39
  ## Load GGUF models
40
 
41
+ You `MUST` follow the prompt template provided by Llama-3:
42
+
43
 
44
  ```sh
45
+ ./llama.cpp/main -m Meta-Llama-3-8B-Instruct.Q2_K.gguf -r '<|eot_id|>' --in-prefix "\n<|start_header_id|>user<|end_header_id|>\n\n" --in-suffix "<|eot_id|><|start_header_id|>assistant<|end_header_id|>
46
+ \n\n" -p "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nYou are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.<|eot_id|>\n<|start_header_id|>user<|end_header_id|>\n\nHi!<|eot_id|>\n<|start_header_id|>assistant<|end_header_id|>\n\n" -n 1024
47
  ```
48
 
49
 
50
 
 
51
  Original README
52
 
53
  ---