Update README.md

README.md

@@ -3,8 +3,25 @@ license: cc-by-nc-4.0
 language:
 - en
 pipeline_tag: text-generation
+datasets:
+- Skylion007/openwebtext
+- Locutusque/TM-DATA
+inference:
+  parameters:
+    do_sample: True
+    temperature: 0.5
+    top_p: 0.5
+    top_k: 39
+    max_new_tokens: 250
+    repetition_penalty: 1.15
 ---
-# Release date
-This model is set to be released by January 7, 2024. This date may be extended.
-Watch the training live here:
-https://wandb.ai/locutusque/TinyMistral-V2/runs/g0rvw6wc/
+# Training
+This model was trained on two datasets, shown in this model page.
+- Skylion007/openwebtext: 1,000,000 examples at a batch size of 32-4096 (1 epoch)
+- Locutusque/TM-DATA: All examples at a batch size of 12288 (3 epochs)
+Training took approximately 500 GPU hours on a single Titan V.
+# Metrics
+You can look at the training metrics here:
+https://wandb.ai/locutusque/TinyMistral-V2/runs/g0rvw6wc
+# License
+This model is released under the cc-by-nc-4.0 license. This is because the data used to train this model is under this same license.