End of training

README.md

@@ -22,7 +22,7 @@ model-index:
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.8
+      value: 0.82
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,8 +32,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [sanchit-gandhi/distilhubert-finetuned-gtzan-5-epochs](https://huggingface.co/sanchit-gandhi/distilhubert-finetuned-gtzan-5-epochs) on the GTZAN dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6688
-- Accuracy: 0.8
+- Loss: 0.6130
+- Accuracy: 0.82
 
 ## Model description
 
@@ -52,23 +52,29 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 3e-05
-- train_batch_size: 16
-- eval_batch_size: 16
+- learning_rate: 9e-05
+- train_batch_size: 4
+- eval_batch_size: 4
 - seed: 42
+- gradient_accumulation_steps: 16
+- total_train_batch_size: 64
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_ratio: 0.2
-- num_epochs: 3
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 7
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Accuracy |
-|:-------------:|:-----:|:----:|:---------------:|:--------:|
-| 0.7322        | 1.0   | 57   | 0.7652          | 0.79     |
-| 0.5307        | 2.0   | 114  | 0.6521          | 0.83     |
-| 0.4953        | 3.0   | 171  | 0.6688          | 0.8      |
+| Training Loss | Epoch  | Step | Validation Loss | Accuracy |
+|:-------------:|:------:|:----:|:---------------:|:--------:|
+| 1.2256        | 0.9956 | 14   | 0.9755          | 0.68     |
+| 0.9523        | 1.9911 | 28   | 0.8490          | 0.75     |
+| 0.6907        | 2.9867 | 42   | 0.7725          | 0.78     |
+| 0.5448        | 3.9822 | 56   | 0.6968          | 0.81     |
+| 0.4604        | 4.9778 | 70   | 0.6409          | 0.81     |
+| 0.4355        | 5.9733 | 84   | 0.6271          | 0.81     |
+| 0.375         | 6.9689 | 98   | 0.6130          | 0.82     |
 
 
 ### Framework versions

runs/Jul06_23-22-27_9b20cc25a8e2/events.out.tfevents.1720308153.9b20cc25a8e2.13458.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e48b4da21b4b55f276738a775289decb7a93f7b1a5dc1fb527209923f5c3525b
-size 12058
+oid sha256:056fece18567de6b9f3b83812ccbd2f24be6f0b62b4799b536c34ed7e930dbae
+size 12723