Hugging Face's logo

ngchuchi
/
roberta-base-squad2-finetuned-BioASQ-ds

Question Answering
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
ngchuchi commited on
Commit
391f5d4
•
1 Parent(s): c099eb2

Model save

Browse files
Files changed (4) hide show
  1. README.md +7 -7
  2. model.safetensors +1 -1
  3. runs/Apr11_23-42-53_4c5df86b73f5/events.out.tfevents.1712878975.4c5df86b73f5.3045.0 +2 -2
  4. runs/Apr11_23-42-53_4c5df86b73f5/events.out.tfevents.1712883459.4c5df86b73f5.3045.1 +3 -0
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [deepset/roberta-base-squad2](https://huggingface.co/deepset/roberta-base-squad2) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.8373
19
 
20
  ## Model description
21
 
@@ -35,8 +35,8 @@ More information needed
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 2e-05
38
- - train_batch_size: 8
39
- - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
@@ -46,10 +46,10 @@ The following hyperparameters were used during training:
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 1.0159 | 1.0 | 1556 | 0.9558 |
50
- | 0.7883 | 2.0 | 3112 | 0.8757 |
51
- | 0.7006 | 3.0 | 4668 | 0.8293 |
52
- | 0.6117 | 4.0 | 6224 | 0.8373 |
53
 
54
 
55
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [deepset/roberta-base-squad2](https://huggingface.co/deepset/roberta-base-squad2) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.7899
19
 
20
  ## Model description
21
 
 
35
 
36
  The following hyperparameters were used during training:
37
  - learning_rate: 2e-05
38
+ - train_batch_size: 16
39
+ - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 1.3244 | 1.0 | 778 | 0.9192 |
50
+ | 0.8033 | 2.0 | 1556 | 0.8350 |
51
+ | 0.6989 | 3.0 | 2334 | 0.8104 |
52
+ | 0.6194 | 4.0 | 3112 | 0.7899 |
53
 
54
 
55
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bb371c44a725e5a5fc2388047b00b142aa80a296eac5b5b8e17f0e30bdf2e2b6
3
  size 496250232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c98f72b865dc95fc7eb4525b9987fe7a48d63386eba4c2ce89831e3c2a40240
3
  size 496250232
runs/Apr11_23-42-53_4c5df86b73f5/events.out.tfevents.1712878975.4c5df86b73f5.3045.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7b8848eaf311bc1ed08215c8c537f097d96ba47d47aadff212dc6ce47e17ee74
3
- size 7121
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc8e92e9f75055e51bee273fa55a483a33dd7b750fafcf3f4af015dc17195cdd
3
+ size 7746
runs/Apr11_23-42-53_4c5df86b73f5/events.out.tfevents.1712883459.4c5df86b73f5.3045.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec39beab2f6c13ccec411e30ea4ee88563f9f1d84bb72b4f862ea637db760545
3
+ size 359