|
--- |
|
license: afl-3.0 |
|
language: uk |
|
--- |
|
## GPT2 being trained on Ukrainian news. |
|
|
|
### General info: |
|
The model is not ready yet but I'm working on it. It also has a relatively small context window, which makes it quite uninteresting. |
|
|
|
### Example of usage: |
|
```python |
|
from transformers import AutoTokenizer, AutoModelForCausalLM |
|
|
|
tokenizer = AutoTokenizer.from_pretrained("kyryl0s/gpt2-uk-xxs") |
|
model = AutoModelForCausalLM.from_pretrained("kyryl0s/gpt2-uk-xxs") |
|
input_ids = tokenizer.encode("Путін — ", add_special_tokens=False, return_tensors='pt') |
|
outputs = model.generate( |
|
input_ids, |
|
do_sample=True, |
|
num_return_sequences=3, |
|
max_length=50 |
|
) |
|
for i, out in enumerate(outputs): |
|
print("{}: {}".format(i, tokenizer.decode(out))) |
|
|
|
``` |
