README.md

metadata

license: apache-2.0
language:
  - en
  - ko
eos_token: </s>
widget:
  - text: 혼자서 사전학습모델 만드는것은 너무 힘듭니다.</s>

long-ke-t5 small

pretrained 1 epoch

Pretrained Long-T5 Model on Korean and English. See Github for more details.

How to use

from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("KETI-AIR/long-ke-t5-small")
tokenizer = AutoTokenizer.from_pretrained("KETI-AIR/long-ke-t5-small")