Base model : mlabonne/NeuralDaredevil-8B-abliteratedDataset : AIffl/french_orca_dpo_pairs
More infos & benchmark soon