Commit
·
1f85bec
1
Parent(s):
fa59049
fixed model card
Browse files
README.md
CHANGED
|
@@ -6,6 +6,7 @@ license: apache-2.0
|
|
| 6 |
library_name: transformers
|
| 7 |
datasets:
|
| 8 |
- allenai/c4
|
|
|
|
| 9 |
## Model Description
|
| 10 |
|
| 11 |
This model is based of <a href="https://huggingface.co/JackFram/llama-68m">llama-68m</a> and was initialized from this model with tied embeddings and then further pretrained on the uncleaned c4 dataset. This model is obviously a beta based on the name and has not been trained on the full training set which is the first 1 million samples of the uncleaned c4 dataset as mentioned above.
|
|
|
|
| 6 |
library_name: transformers
|
| 7 |
datasets:
|
| 8 |
- allenai/c4
|
| 9 |
+
---
|
| 10 |
## Model Description
|
| 11 |
|
| 12 |
This model is based of <a href="https://huggingface.co/JackFram/llama-68m">llama-68m</a> and was initialized from this model with tied embeddings and then further pretrained on the uncleaned c4 dataset. This model is obviously a beta based on the name and has not been trained on the full training set which is the first 1 million samples of the uncleaned c4 dataset as mentioned above.
|