Update README.md
Browse files
README.md
CHANGED
|
@@ -13,16 +13,6 @@ inference:
|
|
| 13 |
# Aeoinum v1 BaseWeb 1B
|
| 14 |
A state-of-the-art language model for Russian language processing. This checkpoint contains a preliminary version of the model with 1.6 billion parameters. Trained only on web pages.
|
| 15 |
|
| 16 |
-
## Models
|
| 17 |
-
| Name | N of parameters | N of dataset tokens | Context window |
|
| 18 |
-
|:---------------------:|:-----------------:|:---------------------:|:--------------:|
|
| 19 |
-
| **Aeonium-v1-BaseWeb-1B** | 1.6B | 32B | 4K |
|
| 20 |
-
| Aeonium-v1-Base-1B | 1.6B | In training | 4K |
|
| 21 |
-
| Aeonium-v1-Chat-1B | 1.6B | In training | 4K |
|
| 22 |
-
| Aeonium-v1-Base-4B | 1.6B | In training | 4K |
|
| 23 |
-
| Aeonium-v1-Chat-4B | 1.6B | In training | 4K |
|
| 24 |
-
|
| 25 |
-
|
| 26 |
## Usage
|
| 27 |
```python
|
| 28 |
from transformers import AutoTokenizer, AutoModelForCausalLM
|
|
|
|
| 13 |
# Aeoinum v1 BaseWeb 1B
|
| 14 |
A state-of-the-art language model for Russian language processing. This checkpoint contains a preliminary version of the model with 1.6 billion parameters. Trained only on web pages.
|
| 15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
## Usage
|
| 17 |
```python
|
| 18 |
from transformers import AutoTokenizer, AutoModelForCausalLM
|