Hugging Face model: ayushshah/Qwen3-1.7B-Chat-LoRA
Author: ayushshah
Created: 2026-07-17 15:23:05
Last modified: 2026-07-18 20:35:16
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 48
Tags: peft, safetensors, qwen3, trl, dpo, alignment, preference-optimization, lora, conversational, text-generation-inference, text-generation, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, dataset:argilla/distilabel-capybara-dpo-7k-binarized, dataset:argilla/distilabel-intel-orca-dpo-pairs, base_model:ayushshah/Qwen3-1.7B-UltraChat-SFT, base_model:adapter:ayushshah/Qwen3-1.7B-UltraChat-SFT, license:apache-2.0, region:us
Base model relation: adapter
Base models: id: ayushshah/Qwen3-1.7B-UltraChat-SFT
Card metadata:
library_name: peft
tags: qwen3, trl, dpo, alignment, preference-optimization, lora, conversational, text-generation-inference
license: apache-2.0
datasets: argilla/ultrafeedback-binarized-preferences-cleaned, argilla/distilabel-capybara-dpo-7k-binarized, argilla/distilabel-intel-orca-dpo-pairs
base_model: ayushshah/Qwen3-1.7B-UltraChat-SFT
pipeline_tag: text-generation