Hugging Face model: mehmetkeremturkcan/SmollerLM-48M-Instruct-ft-dpo
Author: mehmetkeremturkcan
Created: 2025-01-29 16:44:54
Last modified: 2025-01-29 20:34:17
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 3
Tags: transformers, tensorboard, safetensors, llama, text-generation, generated_from_trainer, trl, dpo, conversational, dataset:trl-lib/ultrafeedback_binarized, arxiv:2305.18290, base_model:mehmetkeremturkcan/SmollerLM-48M-Instruct-ft-sft, base_model:finetune:mehmetkeremturkcan/SmollerLM-48M-Instruct-ft-sft, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: mehmetkeremturkcan/SmollerLM-48M-Instruct-ft-sft
Card metadata:
base_model: mehmetkeremturkcan/SmollerLM-48M-Instruct-ft-sft
datasets: trl-lib/ultrafeedback_binarized
library_name: transformers
model_name: SmollerLM-48M-Instruct-ft-dpo
tags: generated_from_trainer, trl, dpo
licence: license