---
license: mit
language:
- ko
pipeline_tag: text-generation
datasets:
- blueapple8259/c4-ko-cleaned
---
[c4-ko-cleaned](https://huggingface.co/datasets/blueapple8259/c4-ko-cleaned)데이터셋 테스트용 모델입니다.

## 모델 정보

vocab size: 52000

max position embeddings: 512

hidden size: 512

num attention heads: 16

num key value heads: 4

num hidden layers: 2