Hugging Face model: zhaviraax/qwen2-rpo-wpo-sigmoid-0.4-batch16
Author: zhaviraax
Created: 2025-02-24 02:21:39
Last modified: 2025-02-24 02:21:49
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, arxiv:1910.09700, region:us
Card metadata:
base_model: unsloth/qwen2-0.5b-instruct-bnb-4bit
library_name: peft