Hugging Face model: tianyil1/MistralForCausalLM_Cal_DPO
Author: tianyil1
Created: 2025-01-25 03:20:02
Last modified: 2025-02-05 09:23:04
Likes: 1 | Downloads: 4
Tags: safetensors, mistral, alignment_handbook-handbook, generated_from_trainer, dataset:HuggingFaceH4/ultrafeedback_binarized, arxiv:2311.07911, arxiv:2210.09261, arxiv:2311.12022, arxiv:2310.16049, arxiv:2406.01574, base_model:alignment-handbook/zephyr-7b-sft-full, base_model:finetune:alignment-handbook/zephyr-7b-sft-full, license:apache-2.0, model-index, region:us
Base model relation: finetune
Base models: id: alignment-handbook/zephyr-7b-sft-full
Card metadata:
license: apache-2.0
base_model: alignment-handbook/zephyr-7b-sft-full
tags: alignment_handbook-handbook, generated_from_trainer
datasets: HuggingFaceH4/ultrafeedback_binarized