Model: Yale-ROSE/Qwen3-4B-dimacs_cube-sft_gpt-oss-120b-dpo_gpt-oss-120b_reasoning-v1
Author: Yale-ROSE
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, qwen3, text-generation, generated_from_trainer, dpo, trl, conversational, arxiv:2305.18290, base_model:Yale-ROSE/Qwen3-4B-sft_dataset_gpt-sft-trl-v2, base_model:finetune:Yale-ROSE/Qwen3-4B-sft_dataset_gpt-sft-trl-v2, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: Yale-ROSE/Qwen3-4B-sft_dataset_gpt-sft-trl-v2
Card metadata: base_model: Yale-ROSE/Qwen3-4B-sft_dataset_gpt-sft-trl-v2
library_name: transformers
model_name: Yale-ROSE-Qwen3-4B-sft_dataset_gpt-sft-trl-v2-dimacs_cube_mix_minmax_openai_gpt-oss-120b_reason_filtered_8k-sft-dpo-v1
tags: generated_from_trainer, dpo, trl
licence: license
Likes: 0 | All-time downloads: 108
Created: 2025-09-15 20:11:20