Update README.md
Browse files
README.md
CHANGED
@@ -9,11 +9,75 @@ tags:
|
|
9 |
|
10 |
An experimental model, fine-tuned using the ["multiplicative-LoRA" method](#the-multiplicative-lora-method) on [c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01).
|
11 |
|
12 |
-
Other experimental models
|
13 |
|
14 |
- [creative-writer-v0.1-bravo-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-bravo-35b) - Scaled the pre-softmax logits by `1.1` during training (and then reset after training).
|
15 |
- [creative-writer-v0.1-charlie-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-charlie-35b) - Scaled the pre-softmax logits by `0.9` during training (and didn't reset after training).
|
16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
---
|
18 |
|
19 |
# Usage
|
|
|
9 |
|
10 |
An experimental model, fine-tuned using the ["multiplicative-LoRA" method](#the-multiplicative-lora-method) on [c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01).
|
11 |
|
12 |
+
Other experimental models which attempt to encourage more diverse/creative text generation:
|
13 |
|
14 |
- [creative-writer-v0.1-bravo-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-bravo-35b) - Scaled the pre-softmax logits by `1.1` during training (and then reset after training).
|
15 |
- [creative-writer-v0.1-charlie-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-charlie-35b) - Scaled the pre-softmax logits by `0.9` during training (and didn't reset after training).
|
16 |
|
17 |
+
<details> <summary>Click to see some (brief) tests on effect of these changes</summary>
|
18 |
+
|
19 |
+
#### Using `command-r-3-2024` with `temperature = 1` and `min-p = 0.01`:
|
20 |
+
|
21 |
+

|
22 |
+
|
23 |
+
#### Using `creative-writer-v0.1-alfa:35b` with `temperature = 1` and `min-p = 0.01`:
|
24 |
+
|
25 |
+

|
26 |
+
|
27 |
+
#### Using `creative-writer-v0.1-bravo:35b` with `temperature = 1` and `min-p = 0.01`:
|
28 |
+
|
29 |
+

|
30 |
+
|
31 |
+
#### Using `creative-writer-v0.1-charlie:35b` with `temperature = 1` and `min-p = 0.01`:
|
32 |
+
|
33 |
+

|
34 |
+
|
35 |
+
---
|
36 |
+
|
37 |
+
#### Using `command-r-3-2024` with `temperature = 1` and `min-p = 0.01`:
|
38 |
+
|
39 |
+

|
40 |
+
|
41 |
+
#### Using `creative-writer-v0.1-alfa:35b` with `temperature = 1` and `min-p = 0.01`:
|
42 |
+
|
43 |
+

|
44 |
+
|
45 |
+
#### Using `creative-writer-v0.1-bravo:35b` with `temperature = 1` and `min-p = 0.01`:
|
46 |
+
|
47 |
+

|
48 |
+
|
49 |
+
#### Using `creative-writer-v0.1-charlie:35b` with `temperature = 1` and `min-p = 0.01`:
|
50 |
+
|
51 |
+

|
52 |
+
|
53 |
+
---
|
54 |
+
|
55 |
+
#### Using `command-r-3-2024` with `temperature = 1` and `min-p = 0.01`:
|
56 |
+
|
57 |
+

|
58 |
+
|
59 |
+
#### Using `creative-writer-v0.1-alfa:35b` with `temperature = 1` and `min-p = 0.01`:
|
60 |
+
|
61 |
+

|
62 |
+
|
63 |
+
#### Using `creative-writer-v0.1-alfa:35b` with `temperature = 1.1` and `min-p = 0.01`:
|
64 |
+
|
65 |
+

|
66 |
+
|
67 |
+
#### Using `creative-writer-v0.1-bravo:35b` with `temperature = 1` and `min-p = 0.01`:
|
68 |
+
|
69 |
+

|
70 |
+
|
71 |
+
#### Using `creative-writer-v0.1-bravo:35b` with `temperature = 0.9` and `min-p = 0.01`:
|
72 |
+
|
73 |
+

|
74 |
+
|
75 |
+
#### Using `creative-writer-v0.1-charlie:35b` with `temperature = 1` and `min-p = 0.01`:
|
76 |
+
|
77 |
+

|
78 |
+
|
79 |
+
</details>
|
80 |
+
|
81 |
---
|
82 |
|
83 |
# Usage
|