mayflowergmbh

/

DiscoPhoenix-7B-dpo

like 1

I just added the mt-bench-de score, just below 7.
it seems like the combination of multiple german models plus german dpo-tuning with a mistral based rejected output improves the quality of the merge a lot.