Update README.md
Browse files
README.md
CHANGED
@@ -4,11 +4,11 @@ datasets:
|
|
4 |
---
|
5 |
|
6 |
## LoRA Info:
|
7 |
-
Please note that this is a highly experimental LoRA model. It may do some good stuff, it
|
8 |
|
9 |
-
Current upload: checkpoint of epoch 1.
|
10 |
|
11 |
The alpaca-lora repo by tloen doesn't *seem* to create an immediately working adapter/peft model until the training is finalized, but I attempted to turn a checkpoint into one.
|
12 |
-
I hope it works for y'all ^~^ Thanks to MetaIX for initial seemingly successful testing of the first uploaded checkpoint (epoch 0.8).
|
13 |
|
14 |
**Wikitext2 eval benchmark for epoch 0.8 upload:** 4.548329830169678 (Thanks to Metal/MetaIX)
|
|
|
4 |
---
|
5 |
|
6 |
## LoRA Info:
|
7 |
+
Please note that this is a highly experimental LoRA model. It may do some good stuff, it might do some undesirable stuff. Hopefully after training is fully done, it'll be for sure good!
|
8 |
|
9 |
+
Current upload: checkpoint of epoch 1.25 (of 3)
|
10 |
|
11 |
The alpaca-lora repo by tloen doesn't *seem* to create an immediately working adapter/peft model until the training is finalized, but I attempted to turn a checkpoint into one.
|
12 |
+
I hope it works for y'all ^~^ Thanks to MetaIX for initial seemingly successful testing of the first uploaded checkpoint (epoch 0.8) as well as epoch 1.
|
13 |
|
14 |
**Wikitext2 eval benchmark for epoch 0.8 upload:** 4.548329830169678 (Thanks to Metal/MetaIX)
|