Ashraf-kasem
/

gpt2_fine_tune_with_callback_PolynomialDecay

Text Generation

generated_from_keras_callback

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Ashraf-kasem commited on Jan 16, 2023

Commit

4ecd040

•

1 Parent(s): 9e339b5

Training in progress epoch 2

Files changed (4) hide show

README.md +6 -5
checkpoint/extra_data.pickle +1 -1
checkpoint/weights.h5 +1 -1
tf_model.h5 +1 -1

README.md CHANGED Viewed

@@ -14,11 +14,11 @@ probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 4.1331
-- Train Accuracy: 0.0067
-- Validation Loss: 4.3297
-- Validation Accuracy: 0.0047
-- Epoch: 1
 ## Model description
@@ -46,6 +46,7 @@ The following hyperparameters were used during training:
 |:----------:|:--------------:|:---------------:|:-------------------:|:-----:|
 | 4.6420     | 0.0092         | 4.4445          | 0.0056              | 0     |
 | 4.1331     | 0.0067         | 4.3297          | 0.0047              | 1     |
 ### Framework versions

 This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
+- Train Loss: 3.9746
+- Train Accuracy: 0.0063
+- Validation Loss: 4.3079
+- Validation Accuracy: 0.0044
+- Epoch: 2
 ## Model description
 |:----------:|:--------------:|:---------------:|:-------------------:|:-----:|
 | 4.6420     | 0.0092         | 4.4445          | 0.0056              | 0     |
 | 4.1331     | 0.0067         | 4.3297          | 0.0047              | 1     |
+| 3.9746     | 0.0063         | 4.3079          | 0.0044              | 2     |
 ### Framework versions

checkpoint/extra_data.pickle CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c74d6008f14f924ca389c59ccbfd1e52b9029643efcfdac552d31da117e449b8
 size 995530137

 version https://git-lfs.github.com/spec/v1
+oid sha256:f8c572786249ee221c4fa0b34eab865d5e1ee1680a0dbddfbd5262546fc2bd15
 size 995530137

checkpoint/weights.h5 CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c562bf7324b29125ff8323fe154fbb91483c7a2ec2664cf6e2a2d26fad079dac
 size 497935440

 version https://git-lfs.github.com/spec/v1
+oid sha256:227b6a88e743dd70a624f9416c4b92f7cd2a5db2d87cfb245cadfb5147a57c7d
 size 497935440

tf_model.h5 CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c562bf7324b29125ff8323fe154fbb91483c7a2ec2664cf6e2a2d26fad079dac
 size 497935440

 version https://git-lfs.github.com/spec/v1
+oid sha256:227b6a88e743dd70a624f9416c4b92f7cd2a5db2d87cfb245cadfb5147a57c7d
 size 497935440