Hugging Face model: HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1
Author: HuggingFaceH4
Created: 2024-04-10 16:00:24
Last modified: 2024-04-18 08:31:56
Pipeline: text-generation
Library: transformers
Likes: 270 | Downloads: 91
Tags: transformers, tensorboard, safetensors, mixtral, text-generation, trl, orpo, generated_from_trainer, conversational, dataset:argilla/distilabel-capybara-dpo-7k-binarized, arxiv:2403.07691, arxiv:2311.07911, base_model:mistral-community/Mixtral-8x22B-v0.1, base_model:finetune:mistral-community/Mixtral-8x22B-v0.1, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us, deploy:sagemaker
Base model relation: finetune
Base models: id: mistral-community/Mixtral-8x22B-v0.1
Card metadata:
license: apache-2.0
base_model: mistral-community/Mixtral-8x22B-v0.1
tags: trl, orpo, generated_from_trainer
datasets: argilla/distilabel-capybara-dpo-7k-binarized
inference: parameters: temperature: 0.7