Update llama3-70b/CHANGELOG.txt
Browse files- llama3-70b/CHANGELOG.txt +1 -0
llama3-70b/CHANGELOG.txt
CHANGED
|
@@ -1 +1,2 @@
|
|
|
|
|
| 1 |
* 20240511: Pushed v0.2 LoRA. Higher context size, and curation/fixes to dataset.
|
|
|
|
| 1 |
+
* 20240521: Pushed v0.3 LoRA, with more deslopping, and dataset fixes. Also uses HQQ quantization instead of QLoRA, which got training up to 8k context size.
|
| 2 |
* 20240511: Pushed v0.2 LoRA. Higher context size, and curation/fixes to dataset.
|