lee

lee221

AI & ML interests

None yet

Organizations

None yet

models 4

lee221/qwen25-7b-dpo-lima-pairrm-adapter

Updated Apr 28 • 2

lee221/qwen3-1.7b-self-aligned-lora

lee221/qwen3-1.7b-backward-lora

lee221/Qwen2-0.5B-GRPO-test

Updated Nov 26, 2025

datasets 2

lee221/assignment4-pairrm-preferences

Viewer • Updated Apr 28 • 50 • 4

lee221/self-alignment-curated-lima

Viewer • Updated Apr 7 • 70 • 3