HachiML commited on
Commit
1a407e5
1 Parent(s): 64a75b4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -1,6 +1,5 @@
1
  ---
2
  license: apache-2.0
3
- base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
4
  tags:
5
  - generated_from_trainer
6
  model-index:
@@ -13,8 +12,8 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # myBit-Llama2-jp-127M-2
15
 
16
- This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on an unknown dataset.
17
- It achieves the following results on the evaluation set:
18
  - Loss: 3.0972
19
 
20
  ## Model description
 
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
 
12
 
13
  # myBit-Llama2-jp-127M-2
14
 
15
+ This model was built by referring to the config in [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0), 123M The model is a pre-trained Bit-Llama2 of Parameters with only 1 epoch on a Japanese dataset.
16
+ The dataset used is [range3/wiki40b-ja](https://huggingface.co/datasets/range3/wiki40b-ja).
17
  - Loss: 3.0972
18
 
19
  ## Model description