Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,5 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
-
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
|
4 |
tags:
|
5 |
- generated_from_trainer
|
6 |
model-index:
|
@@ -13,8 +12,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
13 |
|
14 |
# myBit-Llama2-jp-127M-2
|
15 |
|
16 |
-
This model
|
17 |
-
|
18 |
- Loss: 3.0972
|
19 |
|
20 |
## Model description
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
3 |
tags:
|
4 |
- generated_from_trainer
|
5 |
model-index:
|
|
|
12 |
|
13 |
# myBit-Llama2-jp-127M-2
|
14 |
|
15 |
+
This model was built by referring to the config in [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0), 123M The model is a pre-trained Bit-Llama2 of Parameters with only 1 epoch on a Japanese dataset.
|
16 |
+
The dataset used is [range3/wiki40b-ja](https://huggingface.co/datasets/range3/wiki40b-ja).
|
17 |
- Loss: 3.0972
|
18 |
|
19 |
## Model description
|