Hugging Face model: fedyanin/zephyr-7b-gemma-dpo
Author: fedyanin
Created: 2024-05-14 15:58:28
Last modified: 2024-05-14 17:15:48
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 9
Tags: transformers, tensorboard, safetensors, gemma, text-generation, alignment-handbook, trl, dpo, generated_from_trainer, conversational, dataset:argilla/dpo-mix-7k, base_model:HuggingFaceH4/zephyr-7b-gemma-sft-v0.1, base_model:finetune:HuggingFaceH4/zephyr-7b-gemma-sft-v0.1, license:other, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: HuggingFaceH4/zephyr-7b-gemma-sft-v0.1
Card metadata:
license: other
base_model: HuggingFaceH4/zephyr-7b-gemma-sft-v0.1
tags: alignment-handbook, trl, dpo, generated_from_trainer, trl, dpo, generated_from_trainer
datasets: argilla/dpo-mix-7k