Hugging Face model: sodeniZz/llm-course-hw2-dpo
Author: sodeniZz
Created: 2025-11-11 13:45:50
Last modified: 2025-11-15 09:50:25
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 19
Tags: transformers, safetensors, llama, text-generation, dpo, rlhf, conversational, en, dataset:HumanLLMs/Human-Like-DPO-Dataset, base_model:HuggingFaceTB/SmolLM-135M-Instruct, base_model:finetune:HuggingFaceTB/SmolLM-135M-Instruct, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: HuggingFaceTB/SmolLM-135M-Instruct
Card metadata:
library_name: transformers
tags: dpo, rlhf
datasets: HumanLLMs/Human-Like-DPO-Dataset
language: en
base_model: HuggingFaceTB/SmolLM-135M-Instruct