Dave12121 commited on
Commit
4ead422
1 Parent(s): 198116a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -5
README.md CHANGED
@@ -12,25 +12,28 @@ language:
12
  - en
13
  ---
14
 
15
- <!-- This model card has been generated automatically according to the information Keras had access to. You should
16
- probably proofread and complete it, then remove this comment. -->
17
-
18
  # Dave12121/Fsentiment
19
 
20
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the [financial phrasebank sentences all agree](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_allagree) dataset.
21
- It achieves the following results on the evaluation set [financial phrasebank sentences 75%](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_75agree):
22
  - Train Loss: 0.0517
23
  - Validation Loss: 0.2117
24
  - Train Accuracy: 0.9384
25
  - Epoch: 2
26
 
 
 
 
 
 
 
 
27
  ## Model description
28
 
29
  More information needed
30
 
31
  ## Intended uses & limitations
32
 
33
- More information needed
34
 
35
  ## Training and evaluation data
36
 
 
12
  - en
13
  ---
14
 
 
 
 
15
  # Dave12121/Fsentiment
16
 
17
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the [financial phrasebank sentences all agree](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_allagree) dataset.
 
18
  - Train Loss: 0.0517
19
  - Validation Loss: 0.2117
20
  - Train Accuracy: 0.9384
21
  - Epoch: 2
22
 
23
+ It achieves an macro f1 score on the validation set [financial phrasebank sentences 75%](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_75agree) of: 0.92
24
+
25
+ The testing data is a data subset of the finantial phrasebank in which [66% annotators agreed](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_66agree) on the label.
26
+
27
+ The reported macro f1 score on the test set is: 0.86
28
+
29
+
30
  ## Model description
31
 
32
  More information needed
33
 
34
  ## Intended uses & limitations
35
 
36
+ Model should be treated with care. A simple review showed first signs of gender bias within the model.
37
 
38
  ## Training and evaluation data
39