AbrahamSanders commited on
Commit
91799e5
1 Parent(s): c5da19e

updated readme

Browse files
Files changed (1) hide show
  1. README.md +7 -3
README.md CHANGED
@@ -25,11 +25,15 @@ For example:
25
  The following Dialogues were excluded:
26
  - 146 dialogues where a donation of 0 was made at the end of the task but a non-zero amount was pledged by the persuadee in the dialogue, per the following regular expression: `(?:\$(?:0\.)?[1-9]|[1-9][.0-9]*?(?: ?\$| dollars?| cents?))`
27
 
28
- Stats:
29
  - **Training set**: 587 dialogues, using actual end-task donations as labels
30
  - **Validation set**: 141 dialogues, using manual donation intention labels from Persuasion For Good 'AnnSet'
31
  - **Test set**: 143 dialogues, using manual donation intention labels from Persuasion For Good 'AnnSet'
32
 
33
- **Test Macro F1**: 0.893
 
 
34
 
35
- **Test Accuracy**: 0.902
 
 
 
25
  The following Dialogues were excluded:
26
  - 146 dialogues where a donation of 0 was made at the end of the task but a non-zero amount was pledged by the persuadee in the dialogue, per the following regular expression: `(?:\$(?:0\.)?[1-9]|[1-9][.0-9]*?(?: ?\$| dollars?| cents?))`
27
 
28
+ Data Info:
29
  - **Training set**: 587 dialogues, using actual end-task donations as labels
30
  - **Validation set**: 141 dialogues, using manual donation intention labels from Persuasion For Good 'AnnSet'
31
  - **Test set**: 143 dialogues, using manual donation intention labels from Persuasion For Good 'AnnSet'
32
 
33
+ Training Info:
34
+ - **Loss**: CrossEntropy with class weights: 1.5447 (class 0) and 0.7393 (class 1). These weights were derived from the training split.
35
+ - **Early Stopping**: The checkpoint with the highest validation macro f1 was selected. This occurred at step 35 (see training metrics for more detail).
36
 
37
+ Testing Info:
38
+ - **Test Macro F1**: 0.893
39
+ - **Test Accuracy**: 0.902