AbrahamSanders
commited on
Commit
•
91799e5
1
Parent(s):
c5da19e
updated readme
Browse files
README.md
CHANGED
@@ -25,11 +25,15 @@ For example:
|
|
25 |
The following Dialogues were excluded:
|
26 |
- 146 dialogues where a donation of 0 was made at the end of the task but a non-zero amount was pledged by the persuadee in the dialogue, per the following regular expression: `(?:\$(?:0\.)?[1-9]|[1-9][.0-9]*?(?: ?\$| dollars?| cents?))`
|
27 |
|
28 |
-
|
29 |
- **Training set**: 587 dialogues, using actual end-task donations as labels
|
30 |
- **Validation set**: 141 dialogues, using manual donation intention labels from Persuasion For Good 'AnnSet'
|
31 |
- **Test set**: 143 dialogues, using manual donation intention labels from Persuasion For Good 'AnnSet'
|
32 |
|
33 |
-
|
|
|
|
|
34 |
|
35 |
-
|
|
|
|
|
|
25 |
The following Dialogues were excluded:
|
26 |
- 146 dialogues where a donation of 0 was made at the end of the task but a non-zero amount was pledged by the persuadee in the dialogue, per the following regular expression: `(?:\$(?:0\.)?[1-9]|[1-9][.0-9]*?(?: ?\$| dollars?| cents?))`
|
27 |
|
28 |
+
Data Info:
|
29 |
- **Training set**: 587 dialogues, using actual end-task donations as labels
|
30 |
- **Validation set**: 141 dialogues, using manual donation intention labels from Persuasion For Good 'AnnSet'
|
31 |
- **Test set**: 143 dialogues, using manual donation intention labels from Persuasion For Good 'AnnSet'
|
32 |
|
33 |
+
Training Info:
|
34 |
+
- **Loss**: CrossEntropy with class weights: 1.5447 (class 0) and 0.7393 (class 1). These weights were derived from the training split.
|
35 |
+
- **Early Stopping**: The checkpoint with the highest validation macro f1 was selected. This occurred at step 35 (see training metrics for more detail).
|
36 |
|
37 |
+
Testing Info:
|
38 |
+
- **Test Macro F1**: 0.893
|
39 |
+
- **Test Accuracy**: 0.902
|