wdevazelhes
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -34,7 +34,7 @@ Falcon3-7B-Base supports 4 languages (english, french, spanish, portuguese) and
|
|
34 |
- high RoPE value to support long context understanding: 1000042
|
35 |
- 32k context length
|
36 |
- 131k vocab size
|
37 |
-
- Pretrained on 14 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using
|
38 |
- Supports EN, FR, ES, PT
|
39 |
- Developed by [Technology Innovation Institute](https://www.tii.ae)
|
40 |
- License: TII Falcon-LLM License 2.0
|
|
|
34 |
- high RoPE value to support long context understanding: 1000042
|
35 |
- 32k context length
|
36 |
- 131k vocab size
|
37 |
+
- Pretrained on 14 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 1024 H100 GPU chips
|
38 |
- Supports EN, FR, ES, PT
|
39 |
- Developed by [Technology Innovation Institute](https://www.tii.ae)
|
40 |
- License: TII Falcon-LLM License 2.0
|