Update llama3-70b/CHANGELOG.txt
Browse files- llama3-70b/CHANGELOG.txt +1 -0
llama3-70b/CHANGELOG.txt
CHANGED
|
@@ -1,2 +1,3 @@
|
|
|
|
|
| 1 |
* 20240521: Pushed v0.3 LoRA, with more deslopping, and dataset fixes. Also uses HQQ quantization instead of QLoRA, which got training up to 8k context size.
|
| 2 |
* 20240511: Pushed v0.2 LoRA. Higher context size, and curation/fixes to dataset.
|
|
|
|
| 1 |
+
* 20240525: Pushed v0.4 LoRA, even more deslopping/dataset fixes.
|
| 2 |
* 20240521: Pushed v0.3 LoRA, with more deslopping, and dataset fixes. Also uses HQQ quantization instead of QLoRA, which got training up to 8k context size.
|
| 3 |
* 20240511: Pushed v0.2 LoRA. Higher context size, and curation/fixes to dataset.
|