robingeibel commited on
Commit
54cad84
1 Parent(s): 10f24ed

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -53
README.md CHANGED
@@ -5,56 +5,4 @@ datasets:
5
  - big_patent
6
  model-index:
7
  - name: reformer-finetuned
8
- results: []
9
- ---
10
-
11
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
- should probably proofread and complete it, then remove this comment. -->
13
-
14
- # reformer-finetuned
15
-
16
- This model is a fine-tuned version of ["google/reformer-crime-and-punishment"](https://huggingface.co/google/reformer-crime-and-punishment) on the big_patent dataset, wikipedia, and arxiv.
17
- It achieves the following results on the evaluation set:
18
- - Loss: 0.0000
19
-
20
- ## Model description
21
-
22
- More information needed
23
-
24
- ## Intended uses & limitations
25
-
26
- More information needed
27
-
28
- ## Training and evaluation data
29
-
30
- More information needed
31
-
32
- ## Training procedure
33
-
34
- ### Training hyperparameters
35
-
36
- The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
- - train_batch_size: 64
39
- - eval_batch_size: 64
40
- - seed: 42
41
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
- - lr_scheduler_type: linear
43
- - num_epochs: 3.0
44
- - mixed_precision_training: Native AMP
45
-
46
- ### Training results
47
-
48
- | Training Loss | Epoch | Step | Validation Loss |
49
- |:-------------:|:-----:|:-----:|:---------------:|
50
- | 0.0 | 1.0 | 29934 | 0.0000 |
51
- | 0.0 | 2.0 | 59868 | 0.0000 |
52
- | 0.0 | 3.0 | 89802 | 0.0000 |
53
-
54
-
55
- ### Framework versions
56
-
57
- - Transformers 4.20.1
58
- - Pytorch 1.11.0+cu113
59
- - Datasets 2.3.2
60
- - Tokenizers 0.12.1
 
5
  - big_patent
6
  model-index:
7
  - name: reformer-finetuned
8
+ results: []