adityapatkar commited on
Commit
2a1d075
·
1 Parent(s): 10847c2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -1
README.md CHANGED
@@ -11,6 +11,48 @@ widget:
11
  output:
12
  - label: PROBABILITY POSITIVE
13
  score: 0.8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
- ---
 
11
  output:
12
  - label: PROBABILITY POSITIVE
13
  score: 0.8
14
+ ---
15
+
16
+ ## Model Description
17
+
18
+ TweeBERTa is a fine-tuned version of the RoBERTa base model, specifically tailored for sentiment analysis tasks. This model has been trained on the Sentiment140 dataset, making it highly effective in understanding and categorizing sentiments expressed in text, particularly within the context of social media.
19
+
20
+ ## Training and Evaluation
21
+
22
+ ### Training Data
23
+
24
+ The model was trained on the Sentiment140 dataset, which is a popular dataset for sentiment analysis, especially in the context of tweets.
25
+
26
+ ### Training Procedure
27
+
28
+ - **Loss Function:** Binary Cross Entropy Loss
29
+ - **Optimizer:** Adam Optimizer
30
+ - **Learning Rate Schedule:** Linear decrease, starting at 1e-5 and ending at 1e-7
31
+ - **Epochs:** The model was trained for a total of 10 epochs, split into two cycles of 5 epochs each, with the same learning rate cycle for both.
32
+
33
+ ### Performance
34
+
35
+ The model achieved the following metrics on the evaluation set:
36
+ - **Precision:** 0.8328
37
+ - **Recall:** 0.8687
38
+ - **F1 Score:** 0.8504
39
+ - **Accuracy:** 0.8471
40
 
41
+ ## How to Use
42
+
43
+ This model is ideal for sentiment analysis tasks, particularly in the context of social media and short text snippets. It can be used directly through the transformers library. An example usage is provided in the widget section of this card.
44
+
45
+ ## Limitations and Bias
46
+
47
+ While the model shows high performance on the Sentiment140 dataset, it may not generalize as well to texts from different domains or those that contain complex or subtle expressions of sentiment. Users should also be aware of potential biases inherent in the training data, which may be reflected in the model's predictions.
48
+
49
+ ## Ethical Considerations
50
+
51
+ This model should be used responsibly, considering potential biases and the impact of automated sentiment analysis in various applications, particularly those affecting human decision-making.
52
+
53
+ ## Acknowledgements
54
+
55
+ This model was fine-tuned and evaluated by Aditya Patkar. The base RoBERTa model and the Sentiment140 dataset were important in developing this model.
56
+
57
+ ---
58