Update README.md
Browse files
README.md
CHANGED
|
@@ -28,7 +28,7 @@ I'm not sure if it's better or not yet, or how it does at higher (8k+) contexts
|
|
| 28 |
|
| 29 |
Similar sampler advice applies as for BMT: minP (0.07 - 0.3 to taste) -> temp (either dynatemp 0-4ish, or like a temp of 3-4 with a smoothing factor of around 2.5ish).
|
| 30 |
And yes, that's temp last. It does okay without rep pen up to a point, it doesn't seem to get into a complete jam, but it can start to repeat sentences,
|
| 31 |
-
so you'll probably need some, perhaps 1.
|
| 32 |
(rep pen sucks, but there are better things coming).
|
| 33 |
|
| 34 |
I've mainly tested with LimaRP style Alpaca prompts (instruction/input/response), and briefly with Mistral's own format.
|
|
|
|
| 28 |
|
| 29 |
Similar sampler advice applies as for BMT: minP (0.07 - 0.3 to taste) -> temp (either dynatemp 0-4ish, or like a temp of 3-4 with a smoothing factor of around 2.5ish).
|
| 30 |
And yes, that's temp last. It does okay without rep pen up to a point, it doesn't seem to get into a complete jam, but it can start to repeat sentences,
|
| 31 |
+
so you'll probably need some, perhaps 1.02-1.05 at a 1024 range seems okayish.
|
| 32 |
(rep pen sucks, but there are better things coming).
|
| 33 |
|
| 34 |
I've mainly tested with LimaRP style Alpaca prompts (instruction/input/response), and briefly with Mistral's own format.
|