End of training

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [microsoft/phi-1_5](https://huggingface.co/microsoft/phi-1_5) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.7586
+- Loss: 2.1014
 
 ## Model description
 
@@ -43,22 +43,32 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_ratio: 0.1
-- training_steps: 10000
+- training_steps: 20000
 
 ### Training results
 
 | Training Loss | Epoch | Step  | Validation Loss |
 |:-------------:|:-----:|:-----:|:---------------:|
-| 2.1598        | 3.2   | 1000  | 1.7484          |
-| 1.6682        | 6.4   | 2000  | 1.5604          |
-| 1.5154        | 9.6   | 3000  | 1.4110          |
-| 1.3766        | 12.8  | 4000  | 1.2735          |
-| 1.2458        | 16.0  | 5000  | 1.1389          |
-| 1.1176        | 19.2  | 6000  | 1.0163          |
-| 1.0093        | 22.4  | 7000  | 0.9195          |
-| 0.9166        | 25.6  | 8000  | 0.8406          |
-| 0.8448        | 28.8  | 9000  | 0.7828          |
-| 0.7928        | 32.0  | 10000 | 0.7586          |
+| 2.2954        | 3.2   | 1000  | 1.8424          |
+| 1.747         | 6.4   | 2000  | 1.7355          |
+| 1.6037        | 9.6   | 3000  | 1.6513          |
+| 1.4616        | 12.8  | 4000  | 1.6125          |
+| 1.3183        | 16.0  | 5000  | 1.6114          |
+| 1.1743        | 19.2  | 6000  | 1.6670          |
+| 1.0421        | 22.4  | 7000  | 1.7143          |
+| 0.9229        | 25.6  | 8000  | 1.7434          |
+| 0.8166        | 28.8  | 9000  | 1.8055          |
+| 0.7256        | 32.0  | 10000 | 1.8523          |
+| 0.6435        | 35.2  | 11000 | 1.9160          |
+| 0.5779        | 38.4  | 12000 | 1.9352          |
+| 0.5209        | 41.6  | 13000 | 1.9740          |
+| 0.4739        | 44.8  | 14000 | 2.0014          |
+| 0.4353        | 48.0  | 15000 | 2.0192          |
+| 0.4036        | 51.2  | 16000 | 2.0506          |
+| 0.3814        | 54.4  | 17000 | 2.0678          |
+| 0.3626        | 57.6  | 18000 | 2.0861          |
+| 0.3504        | 60.8  | 19000 | 2.0940          |
+| 0.3391        | 64.0  | 20000 | 2.1014          |
 
 
 ### Framework versions

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b5a877d6e21475df64b41ace986e5c29a46548d455fa7a75a7b02b1166a6e097
+oid sha256:c889ebaab47a44f5bc6e0dfd7cd330132aa09d13a0df207180e0326118d03d58
 size 18908110