Update README.md
Browse files
README.md
CHANGED
@@ -12,25 +12,28 @@ language:
|
|
12 |
- en
|
13 |
---
|
14 |
|
15 |
-
<!-- This model card has been generated automatically according to the information Keras had access to. You should
|
16 |
-
probably proofread and complete it, then remove this comment. -->
|
17 |
-
|
18 |
# Dave12121/Fsentiment
|
19 |
|
20 |
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the [financial phrasebank sentences all agree](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_allagree) dataset.
|
21 |
-
It achieves the following results on the evaluation set [financial phrasebank sentences 75%](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_75agree):
|
22 |
- Train Loss: 0.0517
|
23 |
- Validation Loss: 0.2117
|
24 |
- Train Accuracy: 0.9384
|
25 |
- Epoch: 2
|
26 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
27 |
## Model description
|
28 |
|
29 |
More information needed
|
30 |
|
31 |
## Intended uses & limitations
|
32 |
|
33 |
-
|
34 |
|
35 |
## Training and evaluation data
|
36 |
|
|
|
12 |
- en
|
13 |
---
|
14 |
|
|
|
|
|
|
|
15 |
# Dave12121/Fsentiment
|
16 |
|
17 |
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the [financial phrasebank sentences all agree](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_allagree) dataset.
|
|
|
18 |
- Train Loss: 0.0517
|
19 |
- Validation Loss: 0.2117
|
20 |
- Train Accuracy: 0.9384
|
21 |
- Epoch: 2
|
22 |
|
23 |
+
It achieves an macro f1 score on the validation set [financial phrasebank sentences 75%](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_75agree) of: 0.92
|
24 |
+
|
25 |
+
The testing data is a data subset of the finantial phrasebank in which [66% annotators agreed](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_66agree) on the label.
|
26 |
+
|
27 |
+
The reported macro f1 score on the test set is: 0.86
|
28 |
+
|
29 |
+
|
30 |
## Model description
|
31 |
|
32 |
More information needed
|
33 |
|
34 |
## Intended uses & limitations
|
35 |
|
36 |
+
Model should be treated with care. A simple review showed first signs of gender bias within the model.
|
37 |
|
38 |
## Training and evaluation data
|
39 |
|