Hugging Face model: AIR-hl/Llama-3.2-3B-WPO
Author: AIR-hl
Created: 2025-01-07 13:40:13
Last modified: 2025-01-07 13:54:41
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, tensorboard, safetensors, llama, text-generation, trl, wpo, alignment, custome, chat, conversational, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:tanliboy/llama-3.2-3b-sft, base_model:finetune:tanliboy/llama-3.2-3b-sft, license:llama3.2, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: tanliboy/llama-3.2-3b-sft
Card metadata:
license: llama3.2
datasets: HuggingFaceH4/ultrafeedback_binarized
base_model: tanliboy/llama-3.2-3b-sft
pipeline_tag: text-generation
tags: trl, llama, wpo, alignment, transformers, custome, chat