juraj-juraj commited on
Commit
35b9167
1 Parent(s): dc93f9d

Model save

Browse files
README.md CHANGED
@@ -1,27 +1,11 @@
1
  ---
2
- language:
3
- - en
4
  license: bsd-3-clause
5
  base_model: Salesforce/codet5p-220m
6
  tags:
7
  - generated_from_trainer
8
- datasets:
9
- - juraj-juraj/python_googlestyle_docstrings
10
- metrics:
11
- - bleu
12
  model-index:
13
  - name: t5_codet5p_220m_tuned
14
- results:
15
- - task:
16
- name: Translation
17
- type: translation
18
- dataset:
19
- name: juraj-juraj/python_googlestyle_docstrings
20
- type: juraj-juraj/python_googlestyle_docstrings
21
- metrics:
22
- - name: Bleu
23
- type: bleu
24
- value: 19.7909
25
  ---
26
 
27
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -29,11 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
29
 
30
  # t5_codet5p_220m_tuned
31
 
32
- This model is a fine-tuned version of [Salesforce/codet5p-220m](https://huggingface.co/Salesforce/codet5p-220m) on the juraj-juraj/python_googlestyle_docstrings dataset.
33
- It achieves the following results on the evaluation set:
34
- - Loss: 1.6467
35
- - Bleu: 19.7909
36
- - Gen Len: 54.518
37
 
38
  ## Model description
39
 
@@ -54,11 +34,11 @@ More information needed
54
  The following hyperparameters were used during training:
55
  - learning_rate: 1e-05
56
  - train_batch_size: 6
57
- - eval_batch_size: 4
58
  - seed: 42
59
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
60
  - lr_scheduler_type: linear
61
- - num_epochs: 2
62
 
63
  ### Training results
64
 
@@ -66,7 +46,7 @@ The following hyperparameters were used during training:
66
 
67
  ### Framework versions
68
 
69
- - Transformers 4.35.2
70
- - Pytorch 2.1.0+cu121
71
- - Datasets 2.17.0
72
- - Tokenizers 0.15.1
 
1
  ---
 
 
2
  license: bsd-3-clause
3
  base_model: Salesforce/codet5p-220m
4
  tags:
5
  - generated_from_trainer
 
 
 
 
6
  model-index:
7
  - name: t5_codet5p_220m_tuned
8
+ results: []
 
 
 
 
 
 
 
 
 
 
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
13
 
14
  # t5_codet5p_220m_tuned
15
 
16
+ This model is a fine-tuned version of [Salesforce/codet5p-220m](https://huggingface.co/Salesforce/codet5p-220m) on an unknown dataset.
 
 
 
 
17
 
18
  ## Model description
19
 
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 1e-05
36
  - train_batch_size: 6
37
+ - eval_batch_size: 6
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - num_epochs: 4
42
 
43
  ### Training results
44
 
 
46
 
47
  ### Framework versions
48
 
49
+ - Transformers 4.38.2
50
+ - Pytorch 2.1.2+cu121
51
+ - Datasets 2.18.0
52
+ - Tokenizers 0.15.2
config.json CHANGED
@@ -27,7 +27,7 @@
27
  "relative_attention_max_distance": 128,
28
  "relative_attention_num_buckets": 32,
29
  "torch_dtype": "float32",
30
- "transformers_version": "4.35.2",
31
  "use_cache": true,
32
  "vocab_size": 32100
33
  }
 
27
  "relative_attention_max_distance": 128,
28
  "relative_attention_num_buckets": 32,
29
  "torch_dtype": "float32",
30
+ "transformers_version": "4.38.2",
31
  "use_cache": true,
32
  "vocab_size": 32100
33
  }
generation_config.json CHANGED
@@ -1,7 +1,8 @@
1
  {
 
2
  "bos_token_id": 1,
3
  "decoder_start_token_id": 0,
4
  "eos_token_id": 2,
5
  "pad_token_id": 0,
6
- "transformers_version": "4.35.2"
7
  }
 
1
  {
2
+ "_from_model_config": true,
3
  "bos_token_id": 1,
4
  "decoder_start_token_id": 0,
5
  "eos_token_id": 2,
6
  "pad_token_id": 0,
7
+ "transformers_version": "4.38.2"
8
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e05fcd83a945ccc370d82d56b17a1bbf0d57c777631aa9ab069166087b91ca30
3
  size 891558696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ad5abbc701049238c82eb74dd93119e826a730750b09066edef3f748110dee5
3
  size 891558696
runs/Mar27_17-47-30_abe32346ea06/events.out.tfevents.1711561687.abe32346ea06.4718.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0863f54c0b1b5e11a3189af5e5b4ff5b6dfa32d15b1ba72680879d943c54a73
3
+ size 15532
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2085d51f5a4c54d04f8197872f18ad818ca04b6b0cca806de493810f789a9e53
3
- size 4792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67344d76593a718a3270cabdf64206e7652cb735346bb59fde17959c191fc83c
3
+ size 5048