| license: apache-2.0 | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
| dtype: bfloat16 | |
| Finetuned zyh3826/GML-Mistral-merged-v1 model with DPO using Intel's dataset for neural-chat-7b-v3-1. | |
| Fine-tuning took about an hour on Google Colab A-1000 GPU with 40GB VRAM. |