Understanding R1-Zero-Like Training: A Critical Perspective
Paper • 2503.20783 • Published • 60
How to use yashcse21/financial-sentiment-drgrpo-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "yashcse21/financial-sentiment-drgrpo-lora")Fine-tuned with reinforcement learning on Financial PhraseBank (sentences_50agree).
AI League #5 Problem Statement 2 POC.
loss_type=dr_grpo, scale_rewards=False (arXiv:2503.20783 fix)<answer> tagsunsloth/Qwen2.5-0.5B-Instruct-bnb-4bitBase model
Qwen/Qwen2.5-0.5B