Instructions to use HermitQ/NPCAlign-DPO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use HermitQ/NPCAlign-DPO with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "HermitQ/NPCAlign-DPO") - Notebooks
- Google Colab
- Kaggle
Question about your NPC alignment DPO process
#1
by AustinAligned - opened
Hi, I came across NPCAlign and the Space you built for collecting preference ratings on NPC dialogue. I'm researching how people run preference training on open-weight models. I'm curious how the collected ratings turn into your DPO pairs, and how you figure out whether a run actually improved the dialogue the way you wanted.
Would you be open to a quick chat? Happy to do email if easier, I'm at austin@aureliusaligned.ai.
Just trying to learn, not selling anything.
Thanks either way,
Austin