Hugging Face model: Nishef/SmolLM2-360M-Full_DPO_20251225_043457-merged
Author: Nishef
Created: 2025-12-25 20:45:18
Last modified: 2026-01-08 15:40:32
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 4
Tags: transformers, safetensors, llama, text-generation, alignment, preference-optimization, dpo, thesis-research, kto, fine-tuned, en, dataset:Anthropic/hh-rlhf, dataset:stanfordnlp/shp, dataset:OpenAssistant/oasst1, base_model:HuggingFaceTB/SmolLM2-360M, base_model:finetune:HuggingFaceTB/SmolLM2-360M, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: HuggingFaceTB/SmolLM2-360M
Card metadata:
language: en
license: apache-2.0
library_name: transformers
tags: alignment, preference-optimization, dpo, thesis-research, kto, fine-tuned
base_model: HuggingFaceTB/SmolLM2-360M
datasets: Anthropic/hh-rlhf, stanfordnlp/shp, OpenAssistant/oasst1
pipeline_tag: text-generation