LogischeIP commited on
Commit
729c734
1 Parent(s): 5d32f8f

End of training

Browse files
README.md CHANGED
@@ -18,11 +18,11 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 1.8793
22
- - Accuracy: 0.7143
23
- - F1: 0.7099
24
- - Auc Roc: 0.8948
25
- - Log Loss: 1.8793
26
 
27
  ## Model description
28
 
@@ -42,27 +42,28 @@ More information needed
42
 
43
  The following hyperparameters were used during training:
44
  - learning_rate: 2e-05
45
- - train_batch_size: 32
46
- - eval_batch_size: 32
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
 
50
  - num_epochs: 10
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Auc Roc | Log Loss |
55
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:-------:|:--------:|
56
- | No log | 1.0 | 8 | 1.7750 | 0.7429 | 0.7448 | 0.8959 | 1.7750 |
57
- | No log | 2.0 | 16 | 1.9519 | 0.6857 | 0.6896 | 0.8992 | 1.9519 |
58
- | No log | 3.0 | 24 | 1.8079 | 0.7286 | 0.7293 | 0.8990 | 1.8079 |
59
- | No log | 4.0 | 32 | 1.8638 | 0.6714 | 0.6745 | 0.8975 | 1.8638 |
60
- | No log | 5.0 | 40 | 1.9660 | 0.6714 | 0.6656 | 0.9049 | 1.9660 |
61
- | No log | 6.0 | 48 | 1.9401 | 0.7143 | 0.7042 | 0.8977 | 1.9401 |
62
- | No log | 7.0 | 56 | 1.9271 | 0.7 | 0.6934 | 0.8911 | 1.9271 |
63
- | No log | 8.0 | 64 | 1.9025 | 0.7 | 0.6930 | 0.8896 | 1.9025 |
64
- | No log | 9.0 | 72 | 1.8840 | 0.7143 | 0.7099 | 0.8942 | 1.8840 |
65
- | No log | 10.0 | 80 | 1.8793 | 0.7143 | 0.7099 | 0.8948 | 1.8793 |
66
 
67
 
68
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 5.1316
22
+ - Accuracy: 0.6143
23
+ - F1: 0.6141
24
+ - Auc Roc: 0.8480
25
+ - Log Loss: 4.8354
26
 
27
  ## Model description
28
 
 
42
 
43
  The following hyperparameters were used during training:
44
  - learning_rate: 2e-05
45
+ - train_batch_size: 40
46
+ - eval_batch_size: 10
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - lr_scheduler_warmup_ratio: 0.1
51
  - num_epochs: 10
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Auc Roc | Log Loss |
56
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:-------:|:--------:|
57
+ | No log | 1.0 | 7 | 4.9260 | 0.5714 | 0.5720 | 0.8449 | 4.7441 |
58
+ | No log | 2.0 | 14 | 5.0398 | 0.5857 | 0.5850 | 0.8463 | 4.8234 |
59
+ | No log | 3.0 | 21 | 5.0899 | 0.6 | 0.5983 | 0.8457 | 4.8482 |
60
+ | No log | 4.0 | 28 | 5.1227 | 0.6 | 0.5983 | 0.8471 | 4.8646 |
61
+ | No log | 5.0 | 35 | 5.1350 | 0.6 | 0.5983 | 0.8473 | 4.8639 |
62
+ | No log | 6.0 | 42 | 5.1155 | 0.6143 | 0.6141 | 0.8477 | 4.8342 |
63
+ | No log | 7.0 | 49 | 5.1197 | 0.6143 | 0.6141 | 0.8475 | 4.8321 |
64
+ | No log | 8.0 | 56 | 5.1254 | 0.6143 | 0.6141 | 0.8476 | 4.8331 |
65
+ | No log | 9.0 | 63 | 5.1317 | 0.6143 | 0.6141 | 0.8480 | 4.8364 |
66
+ | 0.0 | 10.0 | 70 | 5.1316 | 0.6143 | 0.6141 | 0.8480 | 4.8354 |
67
 
68
 
69
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7055e111e2a14a8dd20ef63f15c5cb26cbd7d00c1a815ce820508cd5bb53a554
3
  size 267841796
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dab7fa924a376b6147050ef9e459609d10c4022106694f8ab0214b36f05bacad
3
  size 267841796
runs/Jan10_17-30-46_032b48ce4f7d/events.out.tfevents.1704907847.032b48ce4f7d.692.42 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:36010f2f56d87ddea0c4d95a217177bf05d08adb5aa25ba209e5d7241fb48654
3
- size 6848
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9549e575a9ecd8e4121d611feabbc6c630ac457370c3fe2c10a10d2baeb790d7
3
+ size 9719
runs/Jan10_17-43-44_032b48ce4f7d/events.out.tfevents.1704908624.032b48ce4f7d.692.43 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b78061e67381582bae293503c81e7c3dc3ec5487ac12efcf198673b084dac14e
3
+ size 9676
runs/Jan10_17-57-04_032b48ce4f7d/events.out.tfevents.1704909425.032b48ce4f7d.692.44 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d92665e0edc50f0e76451413851f741112939516f56d1560f2e59be5a81dee6f
3
+ size 9675
runs/Jan10_18-14-28_032b48ce4f7d/events.out.tfevents.1704910469.032b48ce4f7d.692.45 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c7b4c57f4912d622922f60bae9eb99c7e9b3be15e674aef6628eb0fac8b7b2f
3
+ size 8221
runs/Jan10_18-19-16_032b48ce4f7d/events.out.tfevents.1704910757.032b48ce4f7d.692.46 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:433538dc9eeb43d4c17b581e60ad8b84b529af964b0237c4525bd5df5aabcda3
3
+ size 9676
runs/Jan10_18-27-09_032b48ce4f7d/events.out.tfevents.1704911230.032b48ce4f7d.692.47 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28ba25be49098ff6e13305a9b5a05ce40812d71f91f415f924262ff8f5f69fdf
3
+ size 9631
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2ab29298db90bbd2271988ce557f77c03fce4ea31d85b093809fbe77b6ba6631
3
  size 4664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a82c5d0055be1ecc1d0e71ca243bf5c1398f45ded786ab2532d1389a8158fde
3
  size 4664