melaseddik commited on
Commit
a8a55cd
1 Parent(s): b6bed06

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -26,7 +26,7 @@ Falcon3-10B-Base supports 4 languages (english, french, spanish, portuguese) and
26
  - high RoPE value to support long context understanding: 1000042
27
  - 32k context length
28
  - 131k vocab size
29
- - Pretrained on 14 Gigatokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 2048 H100 GPU chips
30
  - Supports EN, FR, ES, PT
31
  - Developed by [Technology Innovation Institute](https://www.tii.ae)
32
  - License: TII Falcon-LLM License 2.0
 
26
  - high RoPE value to support long context understanding: 1000042
27
  - 32k context length
28
  - 131k vocab size
29
+ - Depth-up-scaled from **Falcon3-7B-Base** with 2 Gigatokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 2048 H100 GPU chips
30
  - Supports EN, FR, ES, PT
31
  - Developed by [Technology Innovation Institute](https://www.tii.ae)
32
  - License: TII Falcon-LLM License 2.0