Hugging Face model: Nishef/SmolLM2-360M-Full_DPO_20251225_043457
Author: Nishef
Created: 2025-12-25 19:49:41
Last modified: 2026-01-08 15:40:20
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, tensorboard, safetensors, alignment, preference-optimization, dpo, thesis-research, kto, fine-tuned, text-generation, conversational, en, dataset:Anthropic/hh-rlhf, dataset:stanfordnlp/shp, dataset:OpenAssistant/oasst1, base_model:HuggingFaceTB/SmolLM2-360M, base_model:finetune:HuggingFaceTB/SmolLM2-360M, license:apache-2.0, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: HuggingFaceTB/SmolLM2-360M
Card metadata:
language: en
license: apache-2.0
library_name: transformers
tags: alignment, preference-optimization, dpo, thesis-research, kto, fine-tuned
base_model: HuggingFaceTB/SmolLM2-360M
datasets: Anthropic/hh-rlhf, stanfordnlp/shp, OpenAssistant/oasst1
pipeline_tag: text-generation