alex-miller commited on
Commit
200dedb
1 Parent(s): 19247b3

End of training

Browse files
README.md CHANGED
@@ -16,8 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [alex-miller/ODABert](https://huggingface.co/alex-miller/ODABert) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.0613
20
- - Mse: 0.0613
21
 
22
  ## Model description
23
 
@@ -36,7 +35,7 @@ More information needed
36
  ### Training hyperparameters
37
 
38
  The following hyperparameters were used during training:
39
- - learning_rate: 1e-05
40
  - train_batch_size: 24
41
  - eval_batch_size: 24
42
  - seed: 42
@@ -46,18 +45,18 @@ The following hyperparameters were used during training:
46
 
47
  ### Training results
48
 
49
- | Training Loss | Epoch | Step | Validation Loss | Mse |
50
- |:-------------:|:-----:|:----:|:---------------:|:------:|
51
- | 0.066 | 1.0 | 126 | 0.0603 | 0.0603 |
52
- | 0.044 | 2.0 | 252 | 0.0563 | 0.0563 |
53
- | 0.0357 | 3.0 | 378 | 0.0582 | 0.0582 |
54
- | 0.0262 | 4.0 | 504 | 0.0562 | 0.0562 |
55
- | 0.0205 | 5.0 | 630 | 0.0609 | 0.0609 |
56
- | 0.0152 | 6.0 | 756 | 0.0622 | 0.0622 |
57
- | 0.0135 | 7.0 | 882 | 0.0612 | 0.0612 |
58
- | 0.0103 | 8.0 | 1008 | 0.0571 | 0.0571 |
59
- | 0.0097 | 9.0 | 1134 | 0.0617 | 0.0617 |
60
- | 0.0089 | 10.0 | 1260 | 0.0613 | 0.0613 |
61
 
62
 
63
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [alex-miller/ODABert](https://huggingface.co/alex-miller/ODABert) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0562
 
20
 
21
  ## Model description
22
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 8e-07
39
  - train_batch_size: 24
40
  - eval_batch_size: 24
41
  - seed: 42
 
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:-----:|:----:|:---------------:|
50
+ | 0.0862 | 1.0 | 126 | 0.0735 |
51
+ | 0.0769 | 2.0 | 252 | 0.0674 |
52
+ | 0.0713 | 3.0 | 378 | 0.0620 |
53
+ | 0.0637 | 4.0 | 504 | 0.0586 |
54
+ | 0.0586 | 5.0 | 630 | 0.0577 |
55
+ | 0.0563 | 6.0 | 756 | 0.0569 |
56
+ | 0.0548 | 7.0 | 882 | 0.0567 |
57
+ | 0.0528 | 8.0 | 1008 | 0.0564 |
58
+ | 0.051 | 9.0 | 1134 | 0.0563 |
59
+ | 0.0516 | 10.0 | 1260 | 0.0562 |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5e783a8dcfd76ea52e39ba139dfc7d516a1854922172b7de1213b71c379c82d3
3
  size 672705532
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00ace0e789e71eaf54c09ffb9fc75dcec4c191965595c3592e007a74bfd52c2f
3
  size 672705532
runs/Sep09_13-37-27_6d16d2b2acad/events.out.tfevents.1725889049.6d16d2b2acad.362.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa8d154ed77f01cd522c0bc6d2dac8934d80b13786a73ec81a804459199d56dc
3
+ size 8596
runs/Sep09_13-53-30_6d16d2b2acad/events.out.tfevents.1725890014.6d16d2b2acad.362.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdc2267dd43b3ebff6bce60438d77c2f3b9b29d04dae2b06dc533f34bd8d70b2
3
+ size 7634
runs/Sep09_14-06-55_6d16d2b2acad/events.out.tfevents.1725890819.6d16d2b2acad.362.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59b0d3f762bd008345b2ee3d9a1cdd3952f87b7f1e049280beb1b68e9dee76b9
3
+ size 10396
runs/Sep09_14-28-02_6d16d2b2acad/events.out.tfevents.1725892085.6d16d2b2acad.362.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9deba40e98da0e61fbae0e4890dfa4ce66a5e8e97017c71bd5f60e8d8bf9c69c
3
+ size 10396
tokenizer.json CHANGED
@@ -1,11 +1,6 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 512,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
  "padding": null,
10
  "added_tokens": [
11
  {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b236a296173ea5767d17307200e614ff9e5938d963429bfd1a2f706212b788ba
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85235a3d23ad148bf1855f4481621042378b07c3279844c2b58e877e015b6064
3
  size 5176