Eval Runs

eval-en/README.md

@@ -0,0 +1,51 @@
+---
+language:
+- en
+license: apache-2.0
+tags:
+- generated_from_trainer
+datasets:
+- top_v2
+model-index:
+- name: eval-en
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# eval-en
+
+This model is a fine-tuned version of [WillHeld/t5-base-pointer-adv-top_v2](https://huggingface.co/WillHeld/t5-base-pointer-adv-top_v2) on the top_v2 dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 16
+- eval_batch_size: 32
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3.0
+
+### Framework versions
+
+- Transformers 4.24.0
+- Pytorch 1.13.0+cu117
+- Datasets 2.7.0
+- Tokenizers 0.13.2

eval-en/all_results.json

@@ -0,0 +1,8 @@
+{
+    "predict_exact_match": 0.8496583730823772,
+    "predict_loss": 0.02921612560749054,
+    "predict_runtime": 1637.7344,
+    "predict_samples": 38785,
+    "predict_samples_per_second": 23.682,
+    "predict_steps_per_second": 0.741
+}

eval-en/predict_results.json

@@ -0,0 +1,8 @@
+{
+    "predict_exact_match": 0.8496583730823772,
+    "predict_loss": 0.02921612560749054,
+    "predict_runtime": 1637.7344,
+    "predict_samples": 38785,
+    "predict_samples_per_second": 23.682,
+    "predict_steps_per_second": 0.741
+}

eval-hinglish/README.md

@@ -0,0 +1,51 @@
+---
+language:
+- en
+license: apache-2.0
+tags:
+- generated_from_trainer
+datasets:
+- hinglish_top
+model-index:
+- name: eval-hinglish
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# eval-hinglish
+
+This model is a fine-tuned version of [WillHeld/t5-base-pointer-adv-top_v2](https://huggingface.co/WillHeld/t5-base-pointer-adv-top_v2) on the hinglish_top dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 16
+- eval_batch_size: 32
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3.0
+
+### Framework versions
+
+- Transformers 4.24.0
+- Pytorch 1.13.0+cu117
+- Datasets 2.7.0
+- Tokenizers 0.13.2

eval-hinglish/all_results.json

@@ -0,0 +1,8 @@
+{
+    "predict_exact_match": 0.03592814371257485,
+    "predict_loss": 0.93626469373703,
+    "predict_runtime": 364.0921,
+    "predict_samples": 6513,
+    "predict_samples_per_second": 17.888,
+    "predict_steps_per_second": 0.56
+}

eval-hinglish/predict_results.json

@@ -0,0 +1,8 @@
+{
+    "predict_exact_match": 0.03592814371257485,
+    "predict_loss": 0.93626469373703,
+    "predict_runtime": 364.0921,
+    "predict_samples": 6513,
+    "predict_samples_per_second": 17.888,
+    "predict_steps_per_second": 0.56
+}