Commit
•
cf722c1
1
Parent(s):
3e5d768
Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ The importance matrix was trained for ~50K tokens (105 batches of 512 tokens) us
|
|
16 |
|
17 |
**NOTE**: This model [doesn't like repeat penalty](https://huggingface.co/google/gemma-7b-it/discussions/38#65d7b14adb51f7c160769fa1) for some reason, so it seems I need to set it to `1.0` (i.e. disable it):
|
18 |
```
|
19 |
-
main -p "<start_of_turn>user\nWrite an essay about AI.<end_of_turn>\n<start_of_turn>model\n" -e --repeat-penalty 1.0 -ngl 29 -m ggml-gemma-7b-it-
|
20 |
```
|
21 |
The response below was generated using the new IQ3_M quant:
|
22 |
## The Dawn of Tomorrow: Artificial Intelligence and the Human Future
|
|
|
16 |
|
17 |
**NOTE**: This model [doesn't like repeat penalty](https://huggingface.co/google/gemma-7b-it/discussions/38#65d7b14adb51f7c160769fa1) for some reason, so it seems I need to set it to `1.0` (i.e. disable it):
|
18 |
```
|
19 |
+
main -p "<start_of_turn>user\nWrite an essay about AI.<end_of_turn>\n<start_of_turn>model\n" -e --repeat-penalty 1.0 -ngl 29 -m ggml-gemma-7b-it-iq3_m.gguf
|
20 |
```
|
21 |
The response below was generated using the new IQ3_M quant:
|
22 |
## The Dawn of Tomorrow: Artificial Intelligence and the Human Future
|