Question about your NPC alignment DPO process

#1
by AustinAligned - opened

Hi, I came across NPCAlign and the Space you built for collecting preference ratings on NPC dialogue. I'm researching how people run preference training on open-weight models. I'm curious how the collected ratings turn into your DPO pairs, and how you figure out whether a run actually improved the dialogue the way you wanted.

Would you be open to a quick chat? Happy to do email if easier, I'm at austin@aureliusaligned.ai.
Just trying to learn, not selling anything.

Thanks either way,
Austin

Sign up or log in to comment