Hugging Face's logo

ZZZZCCCC
/
codebert_2

Fill-Mask
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
ZZZZCCCC commited on
Commit
02fbd79
•
1 Parent(s): 4ee27c8

Model save

Browse files
Files changed (9) hide show
  1. README.md +8 -10
  2. model.safetensors +1 -1
  3. runs/Apr12_04-47-38_e85794ed3fac/events.out.tfevents.1712897259.e85794ed3fac.5765.0 +3 -0
  4. runs/Apr12_04-48-20_e85794ed3fac/events.out.tfevents.1712897300.e85794ed3fac.5765.1 +3 -0
  5. runs/Apr12_05-16-05_e85794ed3fac/events.out.tfevents.1712898966.e85794ed3fac.5765.2 +3 -0
  6. runs/Apr12_05-23-51_e85794ed3fac/events.out.tfevents.1712899431.e85794ed3fac.5765.3 +3 -0
  7. runs/Apr12_05-24-26_e85794ed3fac/events.out.tfevents.1712899466.e85794ed3fac.5765.4 +3 -0
  8. runs/Apr12_05-46-27_e85794ed3fac/events.out.tfevents.1712900787.e85794ed3fac.5765.5 +3 -0
  9. training_args.bin +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [microsoft/codebert-base-mlm](https://huggingface.co/microsoft/codebert-base-mlm) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.4898
18
 
19
  ## Model description
20
 
@@ -33,25 +33,23 @@ More information needed
33
  ### Training hyperparameters
34
 
35
  The following hyperparameters were used during training:
36
- - learning_rate: 3e-05
37
- - train_batch_size: 12
38
  - eval_batch_size: 8
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
- - num_epochs: 6
43
  - mixed_precision_training: Native AMP
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 0.675 | 1.0 | 511 | 0.5542 |
50
- | 0.5891 | 2.0 | 1022 | 0.5163 |
51
- | 0.5601 | 3.0 | 1533 | 0.5143 |
52
- | 0.539 | 4.0 | 2044 | 0.5076 |
53
- | 0.518 | 5.0 | 2555 | 0.4841 |
54
- | 0.5126 | 6.0 | 3066 | 0.4898 |
55
 
56
 
57
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [microsoft/codebert-base-mlm](https://huggingface.co/microsoft/codebert-base-mlm) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.5386
18
 
19
  ## Model description
20
 
 
33
  ### Training hyperparameters
34
 
35
  The following hyperparameters were used during training:
36
+ - learning_rate: 2e-05
37
+ - train_batch_size: 8
38
  - eval_batch_size: 8
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
+ - num_epochs: 4
43
  - mixed_precision_training: Native AMP
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 0.69 | 1.0 | 767 | 0.5737 |
50
+ | 0.5969 | 2.0 | 1534 | 0.5476 |
51
+ | 0.5939 | 3.0 | 2301 | 0.5581 |
52
+ | 0.5688 | 4.0 | 3068 | 0.5386 |
 
 
53
 
54
 
55
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:753fbe0df24a98ea20020fcbd79df4da6fbb692756dfac8ffcad630653210ed1
3
  size 498813948
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c52f55fd57db019b6e2c0baff31cd7e6470b677be03c6535905c209eabee7665
3
  size 498813948
runs/Apr12_04-47-38_e85794ed3fac/events.out.tfevents.1712897259.e85794ed3fac.5765.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c07055e29e41f0bed646f9b96f325c6728bcbb8ab6ca626bc3d7cc2f44db819
3
+ size 4587
runs/Apr12_04-48-20_e85794ed3fac/events.out.tfevents.1712897300.e85794ed3fac.5765.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5326d44d3cc14b9535e8cd0ef5aab5724b36c44f824d8f58369c7ff63aacda7
3
+ size 7291
runs/Apr12_05-16-05_e85794ed3fac/events.out.tfevents.1712898966.e85794ed3fac.5765.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b65d344116e0d8a0f7b9f6bd7425058b29809ca5b3f0fd53aba1f9e71b98acb
3
+ size 5069
runs/Apr12_05-23-51_e85794ed3fac/events.out.tfevents.1712899431.e85794ed3fac.5765.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1420b63ce84d8777636a112a5b61a7c008f47bc1e2dfacf74e27e6cb766209d8
3
+ size 4587
runs/Apr12_05-24-26_e85794ed3fac/events.out.tfevents.1712899466.e85794ed3fac.5765.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6b9c5cb7f228e842f63c6f01245d9805c05e600b587e7c67b5d4eec647dcdc3
3
+ size 6455
runs/Apr12_05-46-27_e85794ed3fac/events.out.tfevents.1712900787.e85794ed3fac.5765.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7e3a1a610c1a3153f362a3845e09549c7fa6bfbb208cef4b8b48cae5d25dcab
3
+ size 7291
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:edcc73ef10d543c19a6b44d651f9928e63954a46e6d4878d95f02737655d2c9d
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1617be7f11e83c7da5c6b162f9c274539bbe3893560b5a48061e54bb0e722290
3
  size 4920