Hugging Face model: ayushshah/Qwen3-1.7B-Chat
Author: ayushshah
Created: 2026-07-17 16:08:47
Last modified: 2026-07-18 20:50:39
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 590
Tags: transformers, safetensors, qwen3, text-generation, dpo, alignment, preference-optimization, conversational, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, dataset:argilla/distilabel-capybara-dpo-7k-binarized, dataset:argilla/distilabel-intel-orca-dpo-pairs, arxiv:2505.09388, base_model:ayushshah/Qwen3-1.7B-UltraChat-SFT, base_model:finetune:ayushshah/Qwen3-1.7B-UltraChat-SFT, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: ayushshah/Qwen3-1.7B-UltraChat-SFT
Card metadata:
library_name: transformers
tags: dpo, alignment, preference-optimization
license: apache-2.0
datasets: argilla/ultrafeedback-binarized-preferences-cleaned, argilla/distilabel-capybara-dpo-7k-binarized, argilla/distilabel-intel-orca-dpo-pairs
base_model: ayushshah/Qwen3-1.7B-UltraChat-SFT
pipeline_tag: text-generation