Update README.md

README.md

@@ -5,7 +5,43 @@ datasets:
 language:
 - en
 ---
-Pretrained Model: https://huggingface.co/Toten5/Marcoroni-neural-chat-7B-v2
+# Marcoroni-neural-chat-7B-v2_gsm8k
 
+This model is a fine-tuned version of [Toten5/Marcoroni-neural-chat-7B-v2](https://huggingface.co/Toten5/Marcoroni-neural-chat-7B-v2) on the GSM8K dataset.
 
-Fine-tuned on GSM8K training set
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 1e-05
+- train_batch_size: 4
+- eval_batch_size: 8
+- seed: 0
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 5
+
+### Training results
+
+
+
+### Framework versions
+
+- PEFT 0.7.2.dev0
+- Transformers 4.36.2
+- Pytorch 2.1.2
+- Datasets 2.16.1
+- Tokenizers 0.15.1