To stimulate the future of open development of neural text generation in Portuguese, we present both GigaVerbo, a concatenation of deduplicated Portuguese text corpora amounting to 200 billion tokens, and Tucano, a series of decoder-transformers natively pre-trained in Portuguese. All byproducts of our study, including the source code used for training and evaluation, are openly released on GitHub and Hugging Face.

Read our preprint in arXiv.

News

• [29/11/2024] Tucano is mentioned on Deutsche Welle: "Cientistas criam maior banco de dados em português para IA".
• [27/11/2024] Tucano video presentation at the C4AI (USP) [available on YouTube].
• [12/11/2024] "Tucano: Advancing Neural Text Generation for Portuguese" is published as a preprint on ArXiv, with all models and datasets released on Hugging Face.

Community Contributions 🤝

• Demo on how to run inference on Tucano.
• Demo on how to create a simple Chat UI for Tucano using Gradio.
• Tucano OpenVINO is a ported version of Tucano-2b4-Instruct optimized for Intel openVINO inference technology.