license: apache-2.0 | |
datasets: | |
- oscar | |
language: | |
- ko | |
oscar νκ΅μ΄ λ°μ΄ν°μμ νμ΅λ SentencePieceUnigramTokenizer λ° t5 v1.1 λͺ¨λΈμ λλ€. | |
## Usage | |
```python | |
from transformers import AutoTokenizer, T5ForConditionalGeneration | |
tokenizer = AutoTokenizer.from_pretrained('sangmin6600/t5-v1_1-base-ko') | |
model = T5ForConditionalGeneration.from_pretrained('sangmin6600/t5-v1_1-base-ko') | |
``` |