Hugging Face model: ZHLiu627/zephyr-gemma-rpo
Author: ZHLiu627
Created: 2024-05-18 16:43:56
Last modified: 2024-08-01 12:01:32
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, safetensors, gemma, text-generation, alignment-handbook, generated_from_trainer, conversational, dataset:argilla/dpo-mix-7k, base_model:HuggingFaceH4/zephyr-7b-gemma-sft-v0.1, base_model:finetune:HuggingFaceH4/zephyr-7b-gemma-sft-v0.1, license:other, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: HuggingFaceH4/zephyr-7b-gemma-sft-v0.1
Card metadata:
license: other
base_model: HuggingFaceH4/zephyr-7b-gemma-sft-v0.1
tags: alignment-handbook, generated_from_trainer
datasets: argilla/dpo-mix-7k