Update README.md
Browse files
README.md
CHANGED
|
@@ -12,21 +12,13 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 12 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
| 13 |
# lora-out
|
| 14 |
|
| 15 |
-
This model was trained from scratch on the
|
| 16 |
It achieves the following results on the evaluation set:
|
| 17 |
- Loss: 1.6736
|
| 18 |
|
| 19 |
## Model description
|
| 20 |
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
## Intended uses & limitations
|
| 24 |
-
|
| 25 |
-
More information needed
|
| 26 |
-
|
| 27 |
-
## Training and evaluation data
|
| 28 |
-
|
| 29 |
-
More information needed
|
| 30 |
|
| 31 |
## Training procedure
|
| 32 |
|
|
@@ -75,3 +67,5 @@ The following hyperparameters were used during training:
|
|
| 75 |
- Pytorch 2.0.1+cu118
|
| 76 |
- Datasets 2.14.5
|
| 77 |
- Tokenizers 0.14.0
|
|
|
|
|
|
|
|
|
| 12 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
| 13 |
# lora-out
|
| 14 |
|
| 15 |
+
This model was trained from scratch on the [smoll_pippa](https://huggingface.co/datasets/Xilabs/PIPPA-alpaca/viewer/default/smol_pippa?row=0=) dataset.
|
| 16 |
It achieves the following results on the evaluation set:
|
| 17 |
- Loss: 1.6736
|
| 18 |
|
| 19 |
## Model description
|
| 20 |
|
| 21 |
+
Dataset trained on [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
|
| 23 |
## Training procedure
|
| 24 |
|
|
|
|
| 67 |
- Pytorch 2.0.1+cu118
|
| 68 |
- Datasets 2.14.5
|
| 69 |
- Tokenizers 0.14.0
|
| 70 |
+
|
| 71 |
+
If you want to support me, you can [here](https://ko-fi.com/undiai).
|