Upload README.md
Browse files
README.md
CHANGED
@@ -61,9 +61,9 @@ GPU acceleration is now available for Llama 2 70B GGML files, with both CUDA (NV
|
|
61 |
## Prompt template: Chat
|
62 |
|
63 |
```
|
64 |
-
A chat
|
65 |
USER: {prompt}
|
66 |
-
ASSISTANT:
|
67 |
|
68 |
```
|
69 |
|
@@ -125,7 +125,7 @@ For compatibility with latest llama.cpp, please use GGUF files instead.
|
|
125 |
I use the following command line; adjust for your tastes and needs:
|
126 |
|
127 |
```
|
128 |
-
./main -t 10 -ngl 40 -gqa 8 -m airoboros-l2-70b-2.1.ggmlv3.q4_K_M.bin --color -c 4096 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "A chat
|
129 |
```
|
130 |
Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`. If you are fully offloading the model to GPU, use `-t 1`
|
131 |
|
@@ -166,7 +166,7 @@ Donaters will get priority support on any and all AI/LLM/model questions and req
|
|
166 |
|
167 |
**Special thanks to**: Aemon Algiz.
|
168 |
|
169 |
-
**Patreon special mentions**:
|
170 |
|
171 |
|
172 |
Thank you to all my generous patrons and donaters!
|
@@ -204,6 +204,8 @@ This is an instruction fine-tuned llama-2 model, using synthetic data generated
|
|
204 |
- these models just produce text, what you do with that text is your resonsibility
|
205 |
- many people and industries deal with "sensitive" content; imagine if a court stenographer's equipment filtered illegal content - it would be useless
|
206 |
|
|
|
|
|
207 |
### Prompt format
|
208 |
|
209 |
The training code was updated to randomize newline vs space:
|
|
|
61 |
## Prompt template: Chat
|
62 |
|
63 |
```
|
64 |
+
A chat.
|
65 |
USER: {prompt}
|
66 |
+
ASSISTANT:
|
67 |
|
68 |
```
|
69 |
|
|
|
125 |
I use the following command line; adjust for your tastes and needs:
|
126 |
|
127 |
```
|
128 |
+
./main -t 10 -ngl 40 -gqa 8 -m airoboros-l2-70b-2.1.ggmlv3.q4_K_M.bin --color -c 4096 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "A chat.\nUSER: {prompt}\nASSISTANT:"
|
129 |
```
|
130 |
Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`. If you are fully offloading the model to GPU, use `-t 1`
|
131 |
|
|
|
166 |
|
167 |
**Special thanks to**: Aemon Algiz.
|
168 |
|
169 |
+
**Patreon special mentions**: Russ Johnson, J, alfie_i, Alex, NimbleBox.ai, Chadd, Mandus, Nikolai Manek, Ken Nordquist, ya boyyy, Illia Dulskyi, Viktor Bowallius, vamX, Iucharbius, zynix, Magnesian, Clay Pascal, Pierre Kircher, Enrico Ros, Tony Hughes, Elle, Andrey, knownsqashed, Deep Realms, Jerry Meng, Lone Striker, Derek Yates, Pyrater, Mesiah Bishop, James Bentley, Femi Adebogun, Brandon Frisco, SuperWojo, Alps Aficionado, Michael Dempsey, Vitor Caleffi, Will Dee, Edmond Seymore, usrbinkat, LangChain4j, Kacper Wikieł, Luke Pendergrass, John Detwiler, theTransient, Nathan LeClaire, Tiffany J. Kim, biorpg, Eugene Pentland, Stanislav Ovsiannikov, Fred von Graf, terasurfer, Kalila, Dan Guido, Nitin Borwankar, 阿明, Ai Maven, John Villwock, Gabriel Puliatti, Stephen Murray, Asp the Wyvern, danny, Chris Smitley, ReadyPlayerEmma, S_X, Daniel P. Andersen, Olakabola, Jeffrey Morgan, Imad Khwaja, Caitlyn Gatomon, webtim, Alicia Loh, Trenton Dambrowitz, Swaroop Kallakuri, Erik Bjäreholt, Leonard Tan, Spiking Neurons AB, Luke @flexchar, Ajan Kanaga, Thomas Belote, Deo Leter, RoA, Willem Michiel, transmissions 11, subjectnull, Matthew Berman, Joseph William Delisle, David Ziegler, Michael Davis, Johann-Peter Hartmann, Talal Aujan, senxiiz, Artur Olbinski, Rainer Wilmers, Spencer Kim, Fen Risland, Cap'n Zoog, Rishabh Srivastava, Michael Levine, Geoffrey Montalvo, Sean Connelly, Alexandros Triantafyllidis, Pieter, Gabriel Tamborski, Sam, Subspace Studios, Junyu Yang, Pedro Madruga, Vadim, Cory Kujawski, K, Raven Klaugh, Randy H, Mano Prime, Sebastain Graf, Space Cruiser
|
170 |
|
171 |
|
172 |
Thank you to all my generous patrons and donaters!
|
|
|
204 |
- these models just produce text, what you do with that text is your resonsibility
|
205 |
- many people and industries deal with "sensitive" content; imagine if a court stenographer's equipment filtered illegal content - it would be useless
|
206 |
|
207 |
+
Huge thank you to the folks over at [a16z](https://a16z.com/) for sponsoring the costs associated with building models and associated tools!
|
208 |
+
|
209 |
### Prompt format
|
210 |
|
211 |
The training code was updated to randomize newline vs space:
|