Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,6 @@ Other experimental models, based off `creative-writer-v0.1-alfa-35b` that attemp
|
|
| 13 |
|
| 14 |
- [creative-writer-v0.1-bravo-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-bravo-35b) - Scaled the pre-softmax logits by `1.1` during training (and then reset after training).
|
| 15 |
- [creative-writer-v0.1-charlie-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-charlie-35b) - Scaled the pre-softmax logits by `0.9` during training (and didn't reset after training).
|
| 16 |
-
- **[CURRENTLY TRAINING...]** [creative-writer-v0.1-delta-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-delta-35b) - Trained using [Focal Loss](https://arxiv.org/abs/1708.02002) with `gamma=2` (instead of stock [Cross Entropy Loss](https://pytorch.org/docs/stable/generated/torch.nn.CrossEntropyLoss.html)).
|
| 17 |
|
| 18 |
---
|
| 19 |
|
|
@@ -196,9 +195,16 @@ eval_size = 0.01
|
|
| 196 |
}
|
| 197 |
```
|
| 198 |
|
| 199 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 200 |
|
| 201 |
-
 - Scaled the pre-softmax logits by `1.1` during training (and then reset after training).
|
| 15 |
- [creative-writer-v0.1-charlie-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-charlie-35b) - Scaled the pre-softmax logits by `0.9` during training (and didn't reset after training).
|
|
|
|
| 16 |
|
| 17 |
---
|
| 18 |
|
|
|
|
| 195 |
}
|
| 196 |
```
|
| 197 |
|
| 198 |
+
---
|
| 199 |
+
|
| 200 |
+
# Graphs
|
| 201 |
+
|
| 202 |
+
|
| 203 |
+
|
| 204 |
+
|
| 205 |
|
| 206 |
+
|
| 207 |
|
| 208 |
+
|
| 209 |
|
| 210 |
+
|