melaseddik
commited on
Commit
•
a8a55cd
1
Parent(s):
b6bed06
Update README.md
Browse files
README.md
CHANGED
@@ -26,7 +26,7 @@ Falcon3-10B-Base supports 4 languages (english, french, spanish, portuguese) and
|
|
26 |
- high RoPE value to support long context understanding: 1000042
|
27 |
- 32k context length
|
28 |
- 131k vocab size
|
29 |
-
-
|
30 |
- Supports EN, FR, ES, PT
|
31 |
- Developed by [Technology Innovation Institute](https://www.tii.ae)
|
32 |
- License: TII Falcon-LLM License 2.0
|
|
|
26 |
- high RoPE value to support long context understanding: 1000042
|
27 |
- 32k context length
|
28 |
- 131k vocab size
|
29 |
+
- Depth-up-scaled from **Falcon3-7B-Base** with 2 Gigatokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 2048 H100 GPU chips
|
30 |
- Supports EN, FR, ES, PT
|
31 |
- Developed by [Technology Innovation Institute](https://www.tii.ae)
|
32 |
- License: TII Falcon-LLM License 2.0
|