Model: Nishef/SmolLM2-360M-Full_DPO_20251225_043457-merged
Author: Nishef
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, alignment, preference-optimization, dpo, thesis-research, kto, fine-tuned, en, dataset:argilla/ultrafeedback-binarized-preferences-cleaned, base_model:HuggingFaceTB/SmolLM2-360M, base_model:finetune:HuggingFaceTB/SmolLM2-360M, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: HuggingFaceTB/SmolLM2-360M
Card metadata: language: en
license: apache-2.0
library_name: transformers
tags: alignment, preference-optimization, dpo, thesis-research, kto, fine-tuned
base_model: HuggingFaceTB/SmolLM2-360M
datasets: argilla/ultrafeedback-binarized-preferences-cleaned
pipeline_tag: text-generation
Likes: 0 | All-time downloads: 43
Created: 2025-12-25 20:45:18