Update README.md
Browse files
README.md
CHANGED
@@ -33,6 +33,7 @@ This is a version 0.2 and finetuned just so it retains the underlaying Vicuna qu
|
|
33 |
Example:
|
34 |
Input
|
35 |
```
|
|
|
36 |
unce upon time lived name John who have pet monkey Jackie.
|
37 |
one day while walkin down the street he saw his friend Tom coming to him.
|
38 |
"Hey Tom" said John "hows it going?"
|
@@ -45,7 +46,7 @@ Tom struggle to keep his balance as he laugh hystericaly.
|
|
45 |
```
|
46 |
Output
|
47 |
```
|
48 |
-
Once upon a time there lived a man named John who had a pet monkey called Jackie.
|
49 |
One day while walking down the street he saw his friend Tom approaching him.
|
50 |
"Hey Tom," said John. "How's it going?"
|
51 |
|
@@ -61,3 +62,4 @@ Goal: to create the best grammar checker you have ever seen
|
|
61 |
To do:
|
62 |
- train on even larger dataset
|
63 |
- see if finetuning on just plain LLAMA without Vicuna would work better or worse (the theoryu is that it will became very focused on editing and nothing else)
|
|
|
|
33 |
Example:
|
34 |
Input
|
35 |
```
|
36 |
+
USER: Edit the following for spelling and grammar mistakes:
|
37 |
unce upon time lived name John who have pet monkey Jackie.
|
38 |
one day while walkin down the street he saw his friend Tom coming to him.
|
39 |
"Hey Tom" said John "hows it going?"
|
|
|
46 |
```
|
47 |
Output
|
48 |
```
|
49 |
+
ASSISTANT: Once upon a time there lived a man named John who had a pet monkey called Jackie.
|
50 |
One day while walking down the street he saw his friend Tom approaching him.
|
51 |
"Hey Tom," said John. "How's it going?"
|
52 |
|
|
|
62 |
To do:
|
63 |
- train on even larger dataset
|
64 |
- see if finetuning on just plain LLAMA without Vicuna would work better or worse (the theoryu is that it will became very focused on editing and nothing else)
|
65 |
+
- explore what different settings (temperature, top_p, top_k do for this type of finetune)
|