Update README.md
Browse files
README.md
CHANGED
@@ -34,6 +34,11 @@ Your instruction or question here.
|
|
34 |
```
|
35 |
Not using the format will make the model perform significantly worse than intended.
|
36 |
|
|
|
|
|
|
|
|
|
|
|
37 |
## Other Versions
|
38 |
|
39 |
[GGML Versions provided by @TheBloke]()
|
|
|
34 |
```
|
35 |
Not using the format will make the model perform significantly worse than intended.
|
36 |
|
37 |
+
## Tips
|
38 |
+
|
39 |
+
Sampling and settings can make a significant difference for this model, so play around with them. I was also informed by a user that if you are using **KoboldCPP** that using the flag
|
40 |
+
`--unbantokens` may improve model performance **significantly**. This has not been tested by myself, but that is something to keep in mind.
|
41 |
+
|
42 |
## Other Versions
|
43 |
|
44 |
[GGML Versions provided by @TheBloke]()
|