File size: 461 Bytes
f936296
 
750817b
 
 
 
 
 
f936296
750817b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
---
license: mit
datasets:
- oscar
language:
- uk
library_name: transformers
pipeline_tag: text-generation
---

# GPT2 Ukrainian

A generative language model for the Ukrainian language follows the [GPT-2 architecture](https://huggingface.co/gpt2) (124M parameters).

- hidden size: 768
- number of heads: 12
- number of layers: 12
- seq length: 1024
- tokens: 11238113280 (3 epochs)
- steps: 57167

## Training data

- OSCAR
- Wikimedia dumps

## License

MIT