Update README.md
Browse files
README.md
CHANGED
|
@@ -15,6 +15,8 @@ use Vicuna 1.1 prompt format. Alpaca may work fine too, that format is like univ
|
|
| 15 |
|
| 16 |
I had much better results with the fp16 instead of GGUF, GGUF quants seem fucked? I don't know. May be on my side. Had so much nonsense input, had to wrangle settings until I had it coherent, it was working ***Really*** good. Fuck Yi models are a pain to work with.
|
| 17 |
|
|
|
|
|
|
|
| 18 |
Meow.
|
| 19 |
|
| 20 |
```
|
|
|
|
| 15 |
|
| 16 |
I had much better results with the fp16 instead of GGUF, GGUF quants seem fucked? I don't know. May be on my side. Had so much nonsense input, had to wrangle settings until I had it coherent, it was working ***Really*** good. Fuck Yi models are a pain to work with.
|
| 17 |
|
| 18 |
+
You need better care with samplers when handling Yi Models. I have tested that Nyakura works well from 0 to 8k+ context, so I know it is not the model's fault.
|
| 19 |
+
|
| 20 |
Meow.
|
| 21 |
|
| 22 |
```
|