JinbiaoZhu commited on
Commit
991c96e
1 Parent(s): 732c3d5

Model save

Browse files
Files changed (1) hide show
  1. README.md +4 -19
README.md CHANGED
@@ -3,8 +3,6 @@ license: mit
3
  base_model: microsoft/deberta-v3-base
4
  tags:
5
  - generated_from_trainer
6
- datasets:
7
- - eli5_category
8
  model-index:
9
  - name: finetuned-DebertaV3-eli5-askscience-TextGeneration
10
  results: []
@@ -15,9 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # finetuned-DebertaV3-eli5-askscience-TextGeneration
17
 
18
- This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on the eli5_category dataset.
19
- It achieves the following results on the evaluation set:
20
- - Loss: 3.4874
21
 
22
  ## Model description
23
 
@@ -36,25 +32,14 @@ More information needed
36
  ### Training hyperparameters
37
 
38
  The following hyperparameters were used during training:
39
- - learning_rate: 2e-05
40
- - train_batch_size: 24
41
- - eval_batch_size: 24
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
  - num_epochs: 5
46
 
47
- ### Training results
48
-
49
- | Training Loss | Epoch | Step | Validation Loss |
50
- |:-------------:|:-----:|:----:|:---------------:|
51
- | 4.9941 | 1.0 | 1034 | 4.4596 |
52
- | 4.4026 | 2.0 | 2068 | 3.8975 |
53
- | 4.3024 | 3.0 | 3102 | 3.6848 |
54
- | 3.67 | 4.0 | 4136 | 3.5170 |
55
- | 3.6813 | 5.0 | 5170 | 3.5066 |
56
-
57
-
58
  ### Framework versions
59
 
60
  - Transformers 4.38.2
 
3
  base_model: microsoft/deberta-v3-base
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: finetuned-DebertaV3-eli5-askscience-TextGeneration
8
  results: []
 
13
 
14
  # finetuned-DebertaV3-eli5-askscience-TextGeneration
15
 
16
+ This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on an unknown dataset.
 
 
17
 
18
  ## Model description
19
 
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
+ - learning_rate: 5e-05
36
+ - train_batch_size: 48
37
+ - eval_batch_size: 48
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
  - num_epochs: 5
42
 
 
 
 
 
 
 
 
 
 
 
 
43
  ### Framework versions
44
 
45
  - Transformers 4.38.2