Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:2403.07691

Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54
HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1

Text Generation • Updated 25 days ago • 5.8k • 228
argilla/distilabel-capybara-dpo-7k-binarized

Viewer • Updated Mar 23 • 14.2k • 140

Foundation AI Papers (II)

about 5 hours ago

Iterative Reasoning Preference Optimization

Paper • 2404.19733 • Published 13 days ago • 40
Better & Faster Large Language Models via Multi-token Prediction

Paper • 2404.19737 • Published 13 days ago • 59
ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54
KAN: Kolmogorov-Arnold Networks

Paper • 2404.19756 • Published 13 days ago • 86

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54

alignment-learning

Dataset Reset Policy Optimization for RLHF

Paper • 2404.08495 • Published Apr 12 • 8
ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54

Audio Reading - 2403.07691 - ORPO Fine-tuning

Read by Bark: https://drive.google.com/file/d/1no3kjSmexQxlS-KjhRB0jB5hz72Yuhsb/view?usp=sharing

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54

Papers - KAIST AI

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54
ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models

Paper • 2404.07738 • Published Apr 11 • 2
Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Paper • 2405.01535 • Published 11 days ago • 85

Papers - Fine-tuning - Orpo

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54

A General Theoretical Paradigm to Understand Learning from Human Preferences

Paper • 2310.12036 • Published Oct 18, 2023 • 11
ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54
Direct Preference Optimization: Your Language Model is Secretly a Reward Model

Paper • 2305.18290 • Published May 29, 2023 • 37

Contains some information and experiments fine-tuning LLMs using 🤗 `trl.ORPOTrainer`

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 54
HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1

Text Generation • Updated 25 days ago • 5.8k • 228
alvarobartt/mistral-orpo-mix

Text Generation • Updated Mar 24 • 9
alvarobartt/Mistral-7B-v0.1-ORPO

Text Generation • Updated Mar 23 • 865 • 15

Previous
1
2
Next

Company

© Hugging Face

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs