한국어 중심의 CharFormer (Tay et al., 2022) 및 ByT5 (Xue et al., 2021) 기반 모델로, ByT5 버전인 KEByT5 (small, base, large) 모델과 CharFormer 버전인 GBST-KEByT5 모델로 구성.
ETRI LIRS (Language Intelligence Research Section)
company
AI & ML interests
Pretrained Language Models for Korean, Cross-modal (or Vision-language) Pretrained Models, Machine Translation, AI-driven Dialogue Systems
models
7
etri-lirs/eagle-3b-preview
Text Generation
•
Updated
•
68
•
1
etri-lirs/egpt-1.3b-preview
Text Generation
•
Updated
•
47
•
4
etri-lirs/gbst-kebyt5-large-preview
Fill-Mask
•
Updated
•
33
•
1
etri-lirs/gbst-kebyt5-base-preview
Fill-Mask
•
Updated
•
1
•
6
etri-lirs/kebyt5-large-preview
Fill-Mask
•
Updated
•
1
•
5
etri-lirs/kebyt5-base-preview
Fill-Mask
•
Updated
•
3
•
3
etri-lirs/kebyt5-small-preview
Fill-Mask
•
Updated
•
22
•
4
datasets
None public yet