selmamalak commited on
Commit
439bbfd
1 Parent(s): 3c48e5e

Model save

Browse files
Files changed (2) hide show
  1. README.md +80 -0
  2. adapter_model.safetensors +1 -1
README.md ADDED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: peft
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - accuracy
8
+ - precision
9
+ - recall
10
+ - f1
11
+ base_model: facebook/deit-base-patch16-224
12
+ model-index:
13
+ - name: chest-deit-base-finetuned
14
+ results: []
15
+ ---
16
+
17
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+ # chest-deit-base-finetuned
21
+
22
+ This model is a fine-tuned version of [facebook/deit-base-patch16-224](https://huggingface.co/facebook/deit-base-patch16-224) on an unknown dataset.
23
+ It achieves the following results on the evaluation set:
24
+ - Loss: 0.0885
25
+ - Accuracy: 0.9622
26
+ - Precision: 0.9398
27
+ - Recall: 0.9681
28
+ - F1: 0.9526
29
+
30
+ ## Model description
31
+
32
+ More information needed
33
+
34
+ ## Intended uses & limitations
35
+
36
+ More information needed
37
+
38
+ ## Training and evaluation data
39
+
40
+ More information needed
41
+
42
+ ## Training procedure
43
+
44
+ ### Training hyperparameters
45
+
46
+ The following hyperparameters were used during training:
47
+ - learning_rate: 0.005
48
+ - train_batch_size: 16
49
+ - eval_batch_size: 16
50
+ - seed: 42
51
+ - gradient_accumulation_steps: 4
52
+ - total_train_batch_size: 64
53
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
54
+ - lr_scheduler_type: linear
55
+ - num_epochs: 10
56
+ - mixed_precision_training: Native AMP
57
+
58
+ ### Training results
59
+
60
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
61
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
62
+ | 0.2556 | 0.99 | 63 | 0.2019 | 0.9185 | 0.9446 | 0.8469 | 0.8822 |
63
+ | 0.2302 | 1.99 | 127 | 0.1098 | 0.9614 | 0.9396 | 0.9654 | 0.9514 |
64
+ | 0.2258 | 3.0 | 191 | 0.1151 | 0.9622 | 0.9641 | 0.9372 | 0.9496 |
65
+ | 0.1465 | 4.0 | 255 | 0.0733 | 0.9725 | 0.9653 | 0.9633 | 0.9643 |
66
+ | 0.1763 | 4.99 | 318 | 0.0763 | 0.9725 | 0.9703 | 0.9580 | 0.9639 |
67
+ | 0.1627 | 5.99 | 382 | 0.1057 | 0.9571 | 0.9315 | 0.9656 | 0.9466 |
68
+ | 0.1509 | 7.0 | 446 | 0.0701 | 0.9751 | 0.9638 | 0.9725 | 0.9680 |
69
+ | 0.1209 | 8.0 | 510 | 0.1047 | 0.9571 | 0.9315 | 0.9656 | 0.9466 |
70
+ | 0.0961 | 8.99 | 573 | 0.0721 | 0.9734 | 0.9577 | 0.9756 | 0.9662 |
71
+ | 0.1063 | 9.88 | 630 | 0.0885 | 0.9622 | 0.9398 | 0.9681 | 0.9526 |
72
+
73
+
74
+ ### Framework versions
75
+
76
+ - PEFT 0.9.0
77
+ - Transformers 4.38.2
78
+ - Pytorch 2.2.1+cu121
79
+ - Datasets 2.18.0
80
+ - Tokenizers 0.15.2
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cd79f98ab599e2e1aaa0496f14f9b77b5fe764c0c9c7a11b97692962e2bc7d8d
3
  size 2372592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8403f61889602aa29eff4fd1cf77ef546573a1b4ad6545bb683727a8f8df13ba
3
  size 2372592