Hugging Face model: tahamajs/llama-3.2-3b-orpo-lora64-4bit-instruct
Author: tahamajs
Created: 2025-04-03 20:56:00
Last modified: 2025-04-03 21:11:59
Library: transformers
Likes: 3 | Downloads: 0
Tags: transformers, safetensors, unsloth, dpo, orpo, lora, preference-optimization, endpoints_compatible, region:us
Card metadata:
library_name: transformers
tags: unsloth, dpo, orpo, lora, preference-optimization