sahanes
/

TinyLlamaB_alpaca_2k

Generated from Trainer

8-bit precision

Model card Files Files and versions Community

sahanes commited on May 24

Commit

4a7ce7b

•

1 Parent(s): 020674d

End of training

Files changed (2) hide show

README.md +16 -16
adapter_model.bin +1 -1

README.md CHANGED Viewed

@@ -92,7 +92,7 @@ special_tokens:
 This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.2126
 ## Model description
@@ -127,22 +127,22 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 1.4615        | 0.08   | 1    | 1.4899          |
-| 1.3843        | 0.24   | 3    | 1.4852          |
-| 1.367         | 0.48   | 6    | 1.4392          |
-| 1.2688        | 0.72   | 9    | 1.3396          |
-| 1.2259        | 0.96   | 12   | 1.2948          |
-| 1.2523        | 1.16   | 15   | 1.2808          |
-| 1.2271        | 1.4    | 18   | 1.2543          |
-| 1.1347        | 1.6400 | 21   | 1.2350          |
-| 1.2699        | 1.88   | 24   | 1.2299          |
-| 1.1476        | 2.08   | 27   | 1.2232          |
-| 1.1524        | 2.32   | 30   | 1.2192          |
 | 1.1944        | 2.56   | 33   | 1.2198          |
-| 1.1114        | 2.8    | 36   | 1.2165          |
-| 1.151         | 3.04   | 39   | 1.2135          |
-| 1.1887        | 3.24   | 42   | 1.2125          |
-| 1.101         | 3.48   | 45   | 1.2122          |
-| 1.1879        | 3.7200 | 48   | 1.2126          |
 ### Framework versions

 This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T) on the None dataset.
 It achieves the following results on the evaluation set:
+- Loss: 1.2124
 ## Model description
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 1.4615        | 0.08   | 1    | 1.4899          |
+| 1.3853        | 0.24   | 3    | 1.4862          |
+| 1.3665        | 0.48   | 6    | 1.4396          |
+| 1.2677        | 0.72   | 9    | 1.3393          |
+| 1.2261        | 0.96   | 12   | 1.2967          |
+| 1.2513        | 1.16   | 15   | 1.2810          |
+| 1.2266        | 1.4    | 18   | 1.2557          |
+| 1.1349        | 1.6400 | 21   | 1.2344          |
+| 1.2688        | 1.88   | 24   | 1.2275          |
+| 1.1477        | 2.08   | 27   | 1.2242          |
+| 1.1524        | 2.32   | 30   | 1.2217          |
 | 1.1944        | 2.56   | 33   | 1.2198          |
+| 1.1123        | 2.8    | 36   | 1.2134          |
+| 1.1523        | 3.04   | 39   | 1.2126          |
+| 1.1897        | 3.24   | 42   | 1.2102          |
+| 1.1006        | 3.48   | 45   | 1.2143          |
+| 1.1894        | 3.7200 | 48   | 1.2124          |
 ### Framework versions

adapter_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b774497ab17dee0158fea5982160c0faf4423e04cbd389d0c8fc10d0a0bb0839
 size 101036698

 version https://git-lfs.github.com/spec/v1
+oid sha256:c269c21d37e10c7fe8b593a458592bf99a69b465f96d299da24b00b3e8ee265d
 size 101036698