Hugging Face model: tanliboy/zephyr-gemma-2-9b-dpo-4k
Author: tanliboy
Created: 2024-08-11 07:44:58
Last modified: 2024-08-11 20:33:48
Likes: 0 | Downloads: 5
Tags: tensorboard, safetensors, gemma2, alignment-handbook, trl, dpo, generated_from_trainer, dataset:HuggingFaceH4/ultrafeedback_binarized, region:us
Card metadata:
base_model: models/zephyr-gemma-2-9b-sft-4k
tags: alignment-handbook, trl, dpo, generated_from_trainer, trl, dpo, generated_from_trainer
datasets: HuggingFaceH4/ultrafeedback_binarized