Model: AIR-hl/Llama-3.2-1B-DPO
Author: AIR-hl
Pipeline: text-generation
Library: transformers
Tags: transformers, tensorboard, safetensors, llama, text-generation, trl, dpo, alignment, custome, chat, conversational, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:AIR-hl/Llama-3.2-1B-ultrachat200k, base_model:finetune:AIR-hl/Llama-3.2-1B-ultrachat200k, license:llama3.2, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: AIR-hl/Llama-3.2-1B-ultrachat200k
Card metadata: license: llama3.2
datasets: HuggingFaceH4/ultrafeedback_binarized
base_model: AIR-hl/Llama-3.2-1B-ultrachat200k
pipeline_tag: text-generation
tags: trl, llama, dpo, alignment, transformers, custome, chat
Likes: 0 | All-time downloads: 313
Created: 2024-11-28 06:10:32