argilla/notux-8x7b-v1
Text Generation
•
Updated
•
3.85k
•
162
Other Notus experiments
Contains some more experiments with Notus using different variants, different datasets, etc.
Note Full DPO fine-tuning of `mistralai/Mixtral-8x7B-Instruct-v0.1` using `argilla/ultrafeedback-binarized-preferences-cleaned` running in a VM with 8 x H100 80GB