BERTimbau replacement for domain-specific text classification in Portuguese

#7
by naomilago - opened

Hi,

   I'm starting this discussion as I currently have fine-tuned three BERTimbau base models for text classification in a Social Listening project. Now that the beta version was successfully released, I'm looking further to improve the overall performance of the project - so, I'm considering two other options:

      • Build a simple context based agent using this model along with LangChain;
      • Try something around Zero-Shot Classification.

   So, I would like to ask if Sabia would be a good fit - as well as if any of these options above are reasonable and make sense.

Best,
Naomi Lago


Notes:

  • The project uses Brazilian Portuguese data, hence I do have the need to find relevant models that could also perform well in this language.
  • I'm new to this field, so I'd really appreciate any resource recommendations and guidance, in case I missed something.

Sign up or log in to comment