gokuls commited on
Commit
02f518a
1 Parent(s): 871e3f0

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -21
README.md CHANGED
@@ -15,8 +15,8 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [](https://huggingface.co/) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: nan
19
- - Accuracy: 0.0000
20
 
21
  ## Model description
22
 
@@ -35,40 +35,35 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 0.0005
39
- - train_batch_size: 64
40
- - eval_batch_size: 64
41
  - seed: 10
42
  - distributed_type: multi-GPU
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
  - lr_scheduler_warmup_steps: 10000
46
  - num_epochs: 5
47
- - mixed_precision_training: Native AMP
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:------:|:---------------:|:--------:|
53
- | 0.0 | 0.11 | 10000 | nan | 0.0000 |
54
- | 0.0 | 0.22 | 20000 | nan | 0.0000 |
55
- | 0.0 | 0.33 | 30000 | nan | 0.0000 |
56
- | 0.0 | 0.44 | 40000 | nan | 0.0000 |
57
- | 0.0 | 0.55 | 50000 | nan | 0.0000 |
58
- | 0.0 | 0.66 | 60000 | nan | 0.0000 |
59
- | 0.0 | 0.76 | 70000 | nan | 0.0000 |
60
- | 0.0 | 0.87 | 80000 | nan | 0.0000 |
61
- | 0.0 | 0.98 | 90000 | nan | 0.0000 |
62
- | 0.0 | 1.09 | 100000 | nan | 0.0000 |
63
- | 0.0 | 1.2 | 110000 | nan | 0.0000 |
64
- | 0.0 | 1.31 | 120000 | nan | 0.0000 |
65
- | 0.0 | 1.42 | 130000 | nan | 0.0000 |
66
- | 0.0 | 1.53 | 140000 | nan | 0.0000 |
67
 
68
 
69
  ### Framework versions
70
 
71
- - Transformers 4.29.2
72
  - Pytorch 1.14.0a0+410ce96
73
  - Datasets 2.12.0
74
  - Tokenizers 0.13.3
 
15
 
16
  This model is a fine-tuned version of [](https://huggingface.co/) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 6.0612
19
+ - Accuracy: 0.1510
20
 
21
  ## Model description
22
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 1e-05
39
+ - train_batch_size: 48
40
+ - eval_batch_size: 48
41
  - seed: 10
42
  - distributed_type: multi-GPU
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
  - lr_scheduler_warmup_steps: 10000
46
  - num_epochs: 5
 
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:------:|:---------------:|:--------:|
52
+ | 6.6173 | 0.08 | 10000 | 6.5823 | 0.1275 |
53
+ | 6.4901 | 0.16 | 20000 | 6.3925 | 0.1398 |
54
+ | 6.2875 | 0.25 | 30000 | 6.3106 | 0.1439 |
55
+ | 6.2516 | 0.33 | 40000 | 6.2511 | 0.1465 |
56
+ | 6.2457 | 0.41 | 50000 | 6.2064 | 0.1478 |
57
+ | 6.1715 | 0.49 | 60000 | 6.1655 | 0.1486 |
58
+ | 6.0838 | 0.57 | 70000 | 6.1332 | 0.1494 |
59
+ | 6.1575 | 0.66 | 80000 | 6.1049 | 0.1503 |
60
+ | 6.0773 | 0.74 | 90000 | 6.0814 | 0.1504 |
61
+ | 6.1838 | 0.82 | 100000 | 6.0612 | 0.1510 |
 
 
 
 
62
 
63
 
64
  ### Framework versions
65
 
66
+ - Transformers 4.30.0
67
  - Pytorch 1.14.0a0+410ce96
68
  - Datasets 2.12.0
69
  - Tokenizers 0.13.3