---
language: gn
license: mit
datasets:
- wikipedia
- wiktionary
widget:
- text: "Paraguay ha'e peteĩ táva oĩva [MASK] retãme  "
- text: "Augusto Roa Bastos ha'e peteĩ [MASK] arandu"
---

# BERT-i-small-cased (gnBERT-small-cased)

A pre-trained BERT model for **Guarani** (6 layers, cased). Trained on Wikipedia + Wiktionary (~800K tokens).