---
license: mit
language:
- en
pipeline_tag: fill-mask
library_name: transformers
widget:
- text: "The boy was <mask>."
  example_title: "Example 1"
- text: "The cat started to <mask>."
  example_title: "Example 2"
- text: "The <mask> girl was eating."  
  example_title: "Example 3"
---
# roberta-poetry-happiness-crpo

This model is based on the [RoBERTa base model](https://huggingface.co/roberta-base) (125 M parameters) 
fine-tuned on a poetry corpus selected automatically to reflect happy emotions.

The model replaces a masked word, indicated by the `<mask>` tag, with a word associated with **happiness**, while preserving fluency. 

This model was trained by [Teo Ferrari](https://www.linkedin.com/in/teo-ferrari-0a4009176/) 
as part of his Bachelor thesis at [HEIG-VD](https://gaps.heig-vd.ch/public/diplome/rapports.php?id=6763), 
supervised by [Andrei Popescu-Belis](http://iict-space.heig-vd.ch/apu/).
The model is described in "[GPoeT: a Language Model Trained for Rhyme Generation on Synthetic Data](https://aclanthology.org/2023.latechclfl-1.2/)"
and is used in the [CR-PO](https://github.com/heig-iict-ida/crpo) system for [interactive poem generation](https://aclanthology.org/2022.lrec-1.377),
along with several other models for specific topics or emotions.