Update README.md
Browse files
README.md
CHANGED
@@ -4,17 +4,19 @@ language: en
|
|
4 |
license: other
|
5 |
---
|
6 |
|
|
|
7 |
<div style="width: 100%;">
|
8 |
<img src="https://i.imgur.com/EBdldam.jpg" alt="TheBlokeAI" style="width: 100%; min-width: 400px; display: block; margin: auto;">
|
9 |
</div>
|
10 |
<div style="display: flex; justify-content: space-between; width: 100%;">
|
11 |
<div style="display: flex; flex-direction: column; align-items: flex-start;">
|
12 |
-
<p><a href="https://discord.gg/
|
13 |
</div>
|
14 |
<div style="display: flex; flex-direction: column; align-items: flex-end;">
|
15 |
<p><a href="https://www.patreon.com/TheBlokeAI">Want to contribute? TheBloke's Patreon page</a></p>
|
16 |
</div>
|
17 |
</div>
|
|
|
18 |
|
19 |
# Eric Hartford's Samantha 7B GPTQ
|
20 |
|
@@ -71,18 +73,31 @@ It was created with groupsize 128 to ensure higher quality inference, without `-
|
|
71 |
python llama.py /workspace/process/samantha-7B/HF wikitext2 --wbits 4 --true-sequential --groupsize 128 --save_safetensors /workspace/process/Samantha-7B-GPTQ-4bit-128g.no-act-order.safetensors
|
72 |
```
|
73 |
|
74 |
-
|
|
|
75 |
|
76 |
-
|
77 |
|
78 |
-
|
79 |
|
80 |
-
|
81 |
|
82 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
83 |
* Ko-Fi: https://ko-fi.com/TheBlokeAI
|
84 |
-
|
85 |
-
|
|
|
|
|
|
|
|
|
86 |
# Original model card: Samantha 7B
|
87 |
|
88 |
Samantha has been trained in philosophy, psychology, and personal relationships.
|
@@ -97,4 +112,4 @@ She was trained on a custom curated dataset of 6,000 conversations in ShareGPT/V
|
|
97 |
|
98 |
Training 7b took 1 hour on 4x A100 80gb using deepspeed zero3 and flash attention.
|
99 |
|
100 |
-
She will not engage in roleplay, romance, or sexual activity.
|
|
|
4 |
license: other
|
5 |
---
|
6 |
|
7 |
+
<!-- header start -->
|
8 |
<div style="width: 100%;">
|
9 |
<img src="https://i.imgur.com/EBdldam.jpg" alt="TheBlokeAI" style="width: 100%; min-width: 400px; display: block; margin: auto;">
|
10 |
</div>
|
11 |
<div style="display: flex; justify-content: space-between; width: 100%;">
|
12 |
<div style="display: flex; flex-direction: column; align-items: flex-start;">
|
13 |
+
<p><a href="https://discord.gg/Jq4vkcDakD">Chat & support: my new Discord server</a></p>
|
14 |
</div>
|
15 |
<div style="display: flex; flex-direction: column; align-items: flex-end;">
|
16 |
<p><a href="https://www.patreon.com/TheBlokeAI">Want to contribute? TheBloke's Patreon page</a></p>
|
17 |
</div>
|
18 |
</div>
|
19 |
+
<!-- header end -->
|
20 |
|
21 |
# Eric Hartford's Samantha 7B GPTQ
|
22 |
|
|
|
73 |
python llama.py /workspace/process/samantha-7B/HF wikitext2 --wbits 4 --true-sequential --groupsize 128 --save_safetensors /workspace/process/Samantha-7B-GPTQ-4bit-128g.no-act-order.safetensors
|
74 |
```
|
75 |
|
76 |
+
<!-- footer start -->
|
77 |
+
## Discord
|
78 |
|
79 |
+
For further support, and discussions on these models and AI in general, join us at:
|
80 |
|
81 |
+
[TheBloke AI's Discord server](https://discord.gg/Jq4vkcDakD)
|
82 |
|
83 |
+
## Thanks, and how to contribute.
|
84 |
|
85 |
+
Thanks to the [chirper.ai](https://chirper.ai) team!
|
86 |
+
|
87 |
+
I've had a lot of people ask if they can contribute. I enjoy providing models and helping people, and would love to be able to spend even more time doing it, as well as expanding into new projects like fine tuning/training.
|
88 |
+
|
89 |
+
If you're able and willing to contribute it will be most gratefully received and will help me to keep providing more models, and to start work on new AI projects.
|
90 |
+
|
91 |
+
Donaters will get priority support on any and all AI/LLM/model questions and requests, access to a private Discord room, plus other benefits.
|
92 |
+
|
93 |
+
* Patreon: https://patreon.com/TheBlokeAI
|
94 |
* Ko-Fi: https://ko-fi.com/TheBlokeAI
|
95 |
+
|
96 |
+
**Patreon special mentions**: Aemon Algiz, Dmitriy Samsonov, Nathan LeClaire, Trenton Dambrowitz, Mano Prime, David Flickinger, vamX, Nikolai Manek, senxiiz, Khalefa Al-Ahmad, Illia Dulskyi, Jonathan Leane, Talal Aujan, V. Lukas, Joseph William Delisle, Pyrater, Oscar Rangel, Lone Striker, Luke Pendergrass, Eugene Pentland, Sebastain Graf, Johann-Peter Hartman.
|
97 |
+
|
98 |
+
Thank you to all my generous patrons and donaters!
|
99 |
+
<!-- footer end -->
|
100 |
+
|
101 |
# Original model card: Samantha 7B
|
102 |
|
103 |
Samantha has been trained in philosophy, psychology, and personal relationships.
|
|
|
112 |
|
113 |
Training 7b took 1 hour on 4x A100 80gb using deepspeed zero3 and flash attention.
|
114 |
|
115 |
+
She will not engage in roleplay, romance, or sexual activity.
|