End of training

README.md

@@ -2,22 +2,18 @@
 license: apache-2.0
 base_model: distilbert-base-uncased
 tags:
-- generated_from_keras_callback
+- generated_from_trainer
 model-index:
-- name: KarthikAlagarsamy/my_awesome_qa_model
+- name: my_awesome_qa_model
   results: []
 ---
 
-<!-- This model card has been generated automatically according to the information Keras had access to. You should
-probably proofread and complete it, then remove this comment. -->
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
 
-# KarthikAlagarsamy/my_awesome_qa_model
+# my_awesome_qa_model
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
-It achieves the following results on the evaluation set:
-- Train Loss: 5.9255
-- Validation Loss: 5.9239
-- Epoch: 0
 
 ## Model description
 
@@ -36,19 +32,24 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': False, 'is_legacy_optimizer': False, 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 4, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
-- training_precision: float32
+- learning_rate: 2e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 1
 
 ### Training results
 
-| Train Loss | Validation Loss | Epoch |
-|:----------:|:---------------:|:-----:|
-| 5.9255     | 5.9239          | 0     |
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| No log        | 1.0   | 3    | 5.8633          |
 
 
 ### Framework versions
 
 - Transformers 4.38.2
-- TensorFlow 2.15.0
+- Pytorch 2.2.1+cu121
 - Datasets 2.18.0
 - Tokenizers 0.15.2

config.json

@@ -18,6 +18,7 @@
   "seq_classif_dropout": 0.2,
   "sinusoidal_pos_embds": false,
   "tie_weights_": true,
+  "torch_dtype": "float32",
   "transformers_version": "4.38.2",
   "vocab_size": 30522
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:be760ae5fcd122def7adba3e9e7c310226e7d9382bee69f7142e267d70c4cc30
+oid sha256:edb0f2e380408dfd16255c96a99001c377cfea8e317e305195a13c4e6898b85e
 size 265470032

runs/Apr07_04-50-23_f823f34e7072/events.out.tfevents.1712465423.f823f34e7072.1489.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f29fbfe0a51978a78fe49a7c6a4ee1a395fdbf57efbc0827b7ac2b6f428aaea2
+size 4184

runs/Apr07_04-53-33_f823f34e7072/events.out.tfevents.1712465614.f823f34e7072.2085.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3785843dfaec6d7bc2b95b177f8e557fcc105e0d1bc516856763ef8491341440
+size 5067

runs/Apr07_04-58-35_f823f34e7072/events.out.tfevents.1712465916.f823f34e7072.2085.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a891191725056b789f01c9784f23e4e4fcbbceeece15d61f43f49db5c70d83e7
+size 5066

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5548c200e1f6a4bdb1aa8f54037993a65524f965f775579450257055b33139c2
-size 4856
+oid sha256:788b6a9a77f80b6c8259c37743efeabe4bad3789ad43c63bb978041b89de6458
+size 4920