---
language: gn
datasets:
- wikipedia
- wiktionary
widget:
- text: "Paraguay ha'e peteĩ táva oĩva [MASK] retãme  "
---

# BERT-i-tiny-cased (gnBERT-tiny-cased)

A pre-trained BERT model for **Guarani** (2 layers, cased). Trained on Wikipedia + Wiktionary (~800K tokens).