Model: mradermacher/Llama-3.2-3B-DPO-GGUF
Author: mradermacher
Library: transformers
Tags: transformers, gguf, trl, llama, dpo, alignment, custome, chat, en, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:AIR-hl/Llama-3.2-3B-DPO, base_model:quantized:AIR-hl/Llama-3.2-3B-DPO, license:llama3.2, endpoints_compatible, region:us, conversational
Base models (quantized): id: AIR-hl/Llama-3.2-3B-DPO
Card metadata: base_model: AIR-hl/Llama-3.2-3B-DPO
datasets: HuggingFaceH4/ultrafeedback_binarized
language: en
library_name: transformers
license: llama3.2
quantized_by: mradermacher
tags: trl, llama, dpo, alignment, transformers, custome, chat
Likes: 1 | All-time downloads: 1107
Created: 2025-01-06 08:18:42