Commit
•
c95afe2
1
Parent(s):
90255eb
Update README.md
Browse files
README.md
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
datasets:
|
4 |
-
- nicholasKluge/
|
5 |
language:
|
6 |
- pt
|
7 |
metrics:
|
@@ -46,7 +46,7 @@ TeenyTinyLlama is a compact language model based on the Llama 2 architecture ([T
|
|
46 |
- **Architecture:** a Transformer-based model pre-trained via causal language modeling
|
47 |
- **Size:** 162,417,408 parameters
|
48 |
- **Context length:** 2048 tokens
|
49 |
-
- **Dataset:** [
|
50 |
- **Language:** Portuguese
|
51 |
- **Number of steps:** 457,969
|
52 |
- **GPU:** 1 NVIDIA A100-SXM4-40GB
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
datasets:
|
4 |
+
- nicholasKluge/Pt-Corpus-Instruct
|
5 |
language:
|
6 |
- pt
|
7 |
metrics:
|
|
|
46 |
- **Architecture:** a Transformer-based model pre-trained via causal language modeling
|
47 |
- **Size:** 162,417,408 parameters
|
48 |
- **Context length:** 2048 tokens
|
49 |
+
- **Dataset:** [Pt-Corpus Instruct](https://huggingface.co/datasets/nicholasKluge/Pt-Corpus-Instruct) (6.2B tokens)
|
50 |
- **Language:** Portuguese
|
51 |
- **Number of steps:** 457,969
|
52 |
- **GPU:** 1 NVIDIA A100-SXM4-40GB
|