Thamed-Chowdhury
/

qwen-2.5-7B-DPO-split1-16bit-chunk1-low-lr

base_model: unsloth/Qwen2.5-7B-Instruct
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - qwen2
  - trl
  - dpo
license: apache-2.0
language:
  - en

Uploaded model

Developed by: Thamed-Chowdhury
License: apache-2.0
Finetuned from model : unsloth/Qwen2.5-7B-Instruct

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.