trollkotze commited on
Commit
c54c481
1 Parent(s): 67f1230

More explanation in patches/README.

Browse files
Files changed (1) hide show
  1. patches/README.md +9 -5
patches/README.md CHANGED
@@ -1,7 +1,11 @@
1
- Assumption is that you have llama.cpp and repeng directories under the same parent directory, and that Miqu is in llama.cpp/models/miqu-1-70b.q5_K_M.gguf
2
- Copy files from patches/repeng into your repeng diretory.
3
- Apply the diff in patches/llama inside your llama.cpp directory.
4
- Place trainvector.sh in their common parent directory.
5
- Run ./trainvector.sh {name-of-your-vector} to generate a vector based on the prompts generated from your edited repeng/emotion_prompts.py
 
6
 
7
  Or build a better pipeline.
 
 
 
 
1
+ Assumption is that you have llama.cpp and repeng directories under the same parent directory, and that Miqu is in llama.cpp/models/miqu-1-70b.q5_K_M.gguf.
2
+
3
+ - Copy files from patches/repeng into your repeng diretory.
4
+ - Apply the diff in patches/llama inside your llama.cpp directory.
5
+ - Place trainvector.sh in their common parent directory.
6
+ - Run ./trainvector.sh {name-of-your-vector} to generate a vector based on the prompts generated from your edited repeng/emotion_prompts.py
7
 
8
  Or build a better pipeline.
9
+
10
+ Parameters for context and batch size may not be optimal, and can be too small if you have longer prompts. Adjust as needed.
11
+