roberta-base-ko

A roberta model trained from the scratch. It has almost the same structure as roberta-base, but with a few differences.

  • hidden_act: mish
  • position_embedding_type: relative_key_query
Downloads last month
14
Safetensors
Model size
125M params
Tensor type
I64
·
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support