robingeibel commited on
Commit
90d8cdd
1 Parent(s): 3c7bae8

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -2,7 +2,7 @@
2
  tags:
3
  - generated_from_trainer
4
  datasets:
5
- - scientific_papers
6
  model-index:
7
  - name: reformer-finetuned-big_patent-wikipedia-arxiv-16384
8
  results: []
@@ -13,9 +13,9 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # reformer-finetuned-big_patent-wikipedia-arxiv-16384
15
 
16
- This model is a fine-tuned version of [robingeibel/reformer-finetuned-big_patent-wikipedia-arxiv-16384](https://huggingface.co/robingeibel/reformer-finetuned-big_patent-wikipedia-arxiv-16384) on the scientific_papers dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 6.4374
19
 
20
  ## Model description
21
 
@@ -34,7 +34,7 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
  - train_batch_size: 8
39
  - eval_batch_size: 8
40
  - seed: 42
@@ -45,11 +45,11 @@ The following hyperparameters were used during training:
45
 
46
  ### Training results
47
 
48
- | Training Loss | Epoch | Step | Validation Loss |
49
- |:-------------:|:-----:|:------:|:---------------:|
50
- | 6.2765 | 1.0 | 104873 | 6.2908 |
51
- | 6.2281 | 2.0 | 209746 | 6.3285 |
52
- | 6.2325 | 3.0 | 314619 | 6.4374 |
53
 
54
 
55
  ### Framework versions
 
2
  tags:
3
  - generated_from_trainer
4
  datasets:
5
+ - wikipedia
6
  model-index:
7
  - name: reformer-finetuned-big_patent-wikipedia-arxiv-16384
8
  results: []
 
13
 
14
  # reformer-finetuned-big_patent-wikipedia-arxiv-16384
15
 
16
+ This model is a fine-tuned version of [robingeibel/reformer-finetuned-big_patent-wikipedia-arxiv-16384](https://huggingface.co/robingeibel/reformer-finetuned-big_patent-wikipedia-arxiv-16384) on the wikipedia dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 6.5256
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 2.5e-06
38
  - train_batch_size: 8
39
  - eval_batch_size: 8
40
  - seed: 42
 
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:-----:|:-----:|:---------------:|
50
+ | 8.0368 | 1.0 | 3785 | 6.7392 |
51
+ | 6.7992 | 2.0 | 7570 | 6.5576 |
52
+ | 6.6926 | 3.0 | 11355 | 6.5256 |
53
 
54
 
55
  ### Framework versions