Hugging Face model: mradermacher/Llama-3.2-3B-DPO-GGUF
Author: mradermacher
Created: 2025-01-06 08:18:42
Last modified: 2025-01-06 08:45:05
Library: transformers
Likes: 1 | Downloads: 45
Tags: transformers, gguf, trl, llama, dpo, alignment, custome, chat, en, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:AIR-hl/Llama-3.2-3B-DPO, base_model:quantized:AIR-hl/Llama-3.2-3B-DPO, license:llama3.2, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: AIR-hl/Llama-3.2-3B-DPO
Card metadata:
base_model: AIR-hl/Llama-3.2-3B-DPO
datasets: HuggingFaceH4/ultrafeedback_binarized
language: en
library_name: transformers
license: llama3.2
quantized_by: mradermacher
tags: trl, llama, dpo, alignment, transformers, custome, chat