Upload README.md

README.md

@@ -1,3 +1,38 @@
 ---
 license: cc-by-4.0
 ---
+
+
+**pythia-1.4B-finetuned-oa-instructions**
+
+This model is a fine-tuned version of pythia on the oa dataset. It achieves the following results on the evaluation set:
+
+    Loss: 0.1224
+
+**Model description**
+
+More information needed
+
+Intended uses & limitations
+
+More information needed
+
+**Training and evaluation data**
+
+More information needed
+
+**Training procedure**
+
+**Training hyperparameters**
+The following hyperparameters were used during training:
+
+
+* learning_rate: 5e-05
+* train_batch_size: 1
+* eval_batch_size: 2
+* seed: 42
+* optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+* lr_scheduler_type: linear
+* training_steps: 5000
+
+**Training results**