Hugging Face model: jasonhuang3/Ministral-3b-instruct-caldpo-4096
Author: jasonhuang3
Created: 2025-06-06 14:04:30
Last modified: 2025-06-07 08:46:56
Likes: 0 | Downloads: 2
Tags: tensorboard, safetensors, mistral, alignment_handbook-handbook, trl, dpo, generated_from_trainer, dataset:HuggingFaceH4/ultrafeedback_binarized, base_model:ministral/Ministral-3b-instruct, base_model:finetune:ministral/Ministral-3b-instruct, license:apache-2.0, region:us
Base model relation: finetune
Base models: id: ministral/Ministral-3b-instruct
Card metadata:
license: apache-2.0
base_model: ministral/Ministral-3b-instruct
tags: alignment_handbook-handbook, trl, dpo, generated_from_trainer, trl, dpo, alignment_handbook-handbook, generated_from_trainer
datasets: HuggingFaceH4/ultrafeedback_binarized