End of training, 20 epochs, 100 batch size, 1000 writer batch size, 1 gradient accumulation steps, learning rate: 6e-05, 30 s

README.md

@@ -23,7 +23,7 @@ model-index:
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.85
+      value: 0.84
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -33,8 +33,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [ntu-spml/distilhubert](https://huggingface.co/ntu-spml/distilhubert) on the GTZAN dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.8717
-- Accuracy: 0.85
+- Loss: 1.2162
+- Accuracy: 0.84
 
 ## Model description
 
@@ -53,7 +53,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 5e-05
+- learning_rate: 6e-05
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
@@ -67,26 +67,26 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| 2.2468        | 1.0   | 57   | 2.1854          | 0.49     |
-| 1.7605        | 2.0   | 114  | 1.6638          | 0.57     |
-| 1.3717        | 3.0   | 171  | 1.2555          | 0.73     |
-| 0.9699        | 4.0   | 228  | 1.0047          | 0.73     |
-| 0.8116        | 5.0   | 285  | 0.8640          | 0.8      |
-| 0.6814        | 6.0   | 342  | 0.7752          | 0.79     |
-| 0.5183        | 7.0   | 399  | 0.7004          | 0.8      |
-| 0.4177        | 8.0   | 456  | 0.7214          | 0.78     |
-| 0.3187        | 9.0   | 513  | 0.6543          | 0.84     |
-| 0.2413        | 10.0  | 570  | 0.6290          | 0.83     |
-| 0.1829        | 11.0  | 627  | 0.6744          | 0.82     |
-| 0.113         | 12.0  | 684  | 0.6599          | 0.84     |
-| 0.1063        | 13.0  | 741  | 0.6866          | 0.83     |
-| 0.0331        | 14.0  | 798  | 0.8470          | 0.8      |
-| 0.0222        | 15.0  | 855  | 0.8986          | 0.81     |
-| 0.0118        | 16.0  | 912  | 0.7894          | 0.85     |
-| 0.0081        | 17.0  | 969  | 0.8135          | 0.85     |
-| 0.0513        | 18.0  | 1026 | 0.8237          | 0.85     |
-| 0.0044        | 19.0  | 1083 | 0.8425          | 0.85     |
-| 0.0039        | 20.0  | 1140 | 0.8717          | 0.85     |
+| 2.2216        | 1.0   | 57   | 2.1520          | 0.45     |
+| 1.704         | 2.0   | 114  | 1.6254          | 0.59     |
+| 1.1885        | 3.0   | 171  | 1.1741          | 0.7      |
+| 0.8575        | 4.0   | 228  | 0.9653          | 0.7      |
+| 0.6822        | 5.0   | 285  | 0.8219          | 0.81     |
+| 0.5103        | 6.0   | 342  | 0.7254          | 0.8      |
+| 0.4386        | 7.0   | 399  | 0.6772          | 0.84     |
+| 0.2862        | 8.0   | 456  | 0.7047          | 0.8      |
+| 0.1639        | 9.0   | 513  | 0.7126          | 0.8      |
+| 0.0998        | 10.0  | 570  | 0.8339          | 0.77     |
+| 0.0585        | 11.0  | 627  | 0.7380          | 0.8      |
+| 0.0256        | 12.0  | 684  | 0.7606          | 0.84     |
+| 0.0201        | 13.0  | 741  | 0.8292          | 0.83     |
+| 0.0058        | 14.0  | 798  | 0.9495          | 0.83     |
+| 0.0029        | 15.0  | 855  | 1.1009          | 0.82     |
+| 0.0016        | 16.0  | 912  | 1.1451          | 0.82     |
+| 0.001         | 17.0  | 969  | 1.1886          | 0.84     |
+| 0.0071        | 18.0  | 1026 | 1.1731          | 0.84     |
+| 0.0004        | 19.0  | 1083 | 1.2255          | 0.84     |
+| 0.0003        | 20.0  | 1140 | 1.2162          | 0.84     |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8f3d22254e94e07ab0e7b95ab3c33fc079ae3549fc030e891c0253ef0c96b17b
+oid sha256:f5ce8cf5f910e3dfa61c5ba7fd13cf9cb7cc7b4ccba858be96e5ef4790b22f22
 size 94771728