Update README.md
Browse files
README.md
CHANGED
|
@@ -34,6 +34,11 @@ Your instruction or question here.
|
|
| 34 |
```
|
| 35 |
Not using the format will make the model perform significantly worse than intended.
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
## Other Versions
|
| 38 |
|
| 39 |
[GGML Versions provided by @TheBloke]()
|
|
|
|
| 34 |
```
|
| 35 |
Not using the format will make the model perform significantly worse than intended.
|
| 36 |
|
| 37 |
+
## Tips
|
| 38 |
+
|
| 39 |
+
Sampling and settings can make a significant difference for this model, so play around with them. I was also informed by a user that if you are using **KoboldCPP** that using the flag
|
| 40 |
+
`--unbantokens` may improve model performance **significantly**. This has not been tested by myself, but that is something to keep in mind.
|
| 41 |
+
|
| 42 |
## Other Versions
|
| 43 |
|
| 44 |
[GGML Versions provided by @TheBloke]()
|