Tomás F commited on
Commit
dd37c58
1 Parent(s): 595bd66

Update model weights and readme

Browse files
Files changed (2) hide show
  1. README.md +23 -2
  2. pytorch_model.bin +2 -2
README.md CHANGED
@@ -7,13 +7,34 @@ tags:
7
  datasets:
8
  - financial_phrasebank
9
  widget:
10
- - text: "FTSE100 fell sharply today."
11
- - text: "Oil near one-month high."
 
 
12
  ---
13
 
14
  # FINPerceiver
15
  FINPerceiver is a fine-tuned Perceiver IO language model for financial sentiment analysis.
16
  More details on the training process of this model are available on the [GitHub repository](https://github.com/warwickai/fin-perceiver).
17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  ## Datasets
19
  This model was trained on the Financial PhraseBank (>= 50% agreement)
 
7
  datasets:
8
  - financial_phrasebank
9
  widget:
10
+ - text: "INDEX100 fell sharply today."
11
+ - text: "ImaginaryJetCo bookings hit by Omicron variant as losses total £1bn."
12
+ - text: "Q1 ImaginaryGame's earnings beat expectations."
13
+ - text: "Should we buy IMAGINARYSTOCK today?"
14
  ---
15
 
16
  # FINPerceiver
17
  FINPerceiver is a fine-tuned Perceiver IO language model for financial sentiment analysis.
18
  More details on the training process of this model are available on the [GitHub repository](https://github.com/warwickai/fin-perceiver).
19
 
20
+ We achieved the following results with 10-fold cross validation.
21
+
22
+ ```
23
+ eval/accuracy 0.8624 (stdev 0.01922)
24
+ eval/f1 0.8416 (stdev 0.03738)
25
+ eval/loss 0.4314 (stdev 0.05295)
26
+ eval/precision 0.8438 (stdev 0.02938)
27
+ eval/recall 0.8415 (stdev 0.04458)
28
+ ```
29
+
30
+ The hyperparameters used are as follows.
31
+
32
+ ```
33
+ per_device_train_batch_size 16
34
+ per_device_eval_batch_size 16
35
+ num_train_epochs 4
36
+ learning_rate 2e-5
37
+ ```
38
+
39
  ## Datasets
40
  This model was trained on the Financial PhraseBank (>= 50% agreement)
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1afcdf5aa5ad0e792f01f13fa80fb30626b5a8f3a501a30cadaefe6b9c0b5e5e
3
- size 824589613
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a215a79a89c02c5821329e584c6de405e44dda87d1ebd7e4923fc46f927cf878
3
+ size 824551789