This model has been fine-tuned on Scibert specifically for sentiment classification in scientific texts. Its primary task is to categorize the sentiment expressed by the author based on the context of the sentence. The model classifies the sentiment into one of three classes: positive, negative, or neutral. The positive class is assigned when the author expresses a positive sentiment in the text, while the negative class is used when a negative sentiment is conveyed. The neutral class is assigned when the text does not exhibit any strong positive or negative sentiment.
This model outputs following classnames according to the sentiment:
- Positive sentiment in context is classified as p
- Negative sentiment in context is classified as n
- Neutral sentiment in context is classified as (other) o
The model achieved F1 score of 0.72 and an accuracy score of 0.73, with the manually annoted dataset: https://huggingface.co/datasets/puzzz21/sci-sentiment-annotated-dataset .
For finetuning, the publicly available dataset on context identification from Angrosh et al. https://dl.acm.org/doi/10.1145/1816123.1816168 is used.
- Downloads last month
- 16