Update README.md
Browse files
README.md
CHANGED
@@ -3,13 +3,20 @@ license: other
|
|
3 |
---
|
4 |
Experimental: Created using an unofficial and unsupported method. I have no metrics on how this performs against 13b and I'm not planning on gathering any at this point. Still has weak spots that need work.
|
5 |
|
6 |
-
|
7 |
|
8 |
First, I trained it on an epoch of https://huggingface.co/datasets/Adapting/empathetic_dialogues_v2 to give it a decent base knowledge of a casual chat style. The result was conversational, but not very smart.
|
9 |
|
10 |
Then I trained it on an epoch of https://huggingface.co/datasets/vicgalle/alpaca-gpt4 and landed here, a model that is capable of chatting but very focused on following instructions.
|
11 |
|
12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
Standard prompt format examples:
|
15 |
|
|
|
3 |
---
|
4 |
Experimental: Created using an unofficial and unsupported method. I have no metrics on how this performs against 13b and I'm not planning on gathering any at this point. Still has weak spots that need work.
|
5 |
|
6 |
+
https://huggingface.co/nkpz/llama2-22b-blocktriangular-alpaca with further instruction and chat fine tuning
|
7 |
|
8 |
First, I trained it on an epoch of https://huggingface.co/datasets/Adapting/empathetic_dialogues_v2 to give it a decent base knowledge of a casual chat style. The result was conversational, but not very smart.
|
9 |
|
10 |
Then I trained it on an epoch of https://huggingface.co/datasets/vicgalle/alpaca-gpt4 and landed here, a model that is capable of chatting but very focused on following instructions.
|
11 |
|
12 |
+
**Future Ideas**
|
13 |
+
- This strongly prefers the alpaca prompt format and will try to autocomplete it if you don't provide it. I'd like to work on removing this fixation and making it more flexible.
|
14 |
+
- Also would like to filter the rows with phrases "AI assistant" and "virtual assistant" from all future runs.
|
15 |
+
- Thinking it might also help to do a short run on a dataset focused on character impersonation
|
16 |
+
|
17 |
+
|
18 |
+
**Prompting**
|
19 |
+
|
20 |
|
21 |
Standard prompt format examples:
|
22 |
|