Leandro von Werra's picture

Leandro von Werra

lvwerra

·

https://github.com/lvwerra

lvwerra

lvwerra

AI & ML interests

NLP and RL

Articles

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Welcome Llama 3 - Meta's new open LLM

StarCoder2 and The Stack v2

Constitutional AI with Open LLMs

Preference Tuning LLMs with Direct Preference Optimization Methods

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

The N Implementation Details of RLHF with PPO

Finetune Stable Diffusion Models with DDPO via TRL

Spread Your Wings: Falcon 180B is here

Code Llama: Llama 2 learns to code

Fine-tune Llama 2 with DPO

The Falcon has landed in the Hugging Face ecosystem

Creating a Coding Assistant with StarCoder

StarCoder: A State-of-the-Art LLM for Code

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Evaluating Language Model Bias with 🤗 Evaluate

Announcing Evaluation on the Hub

Organizations

lvwerra's activity

upvoted an article 3 days ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

4 days ago

• 55

upvoted 2 papers 10 days ago

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Paper • 2402.09844 • Published Feb 15 • 16

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published 11 days ago • 226

upvoted an article 14 days ago

Article

Welcome Llama 3 - Meta's new open LLM

15 days ago

• 228

upvoted a paper about 2 months ago

DoGE: Domain Reweighting with Generalization Estimation

Paper • 2310.15393 • Published Oct 23, 2023 • 1

upvoted a collection about 2 months ago

💫 StarCoder2

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 72

upvoted a paper 2 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 120

upvoted a paper 3 months ago

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 134

upvoted a collection 4 months ago

Comparing DPO with IPO and KTO

A collection of chat models to explore the differences between three alignment techniques: DPO, IPO, and KTO. • 56 items • Updated Jan 9 • 31

upvoted 2 papers 4 months ago

Possible Meissner effect near room temperature in copper-substituted lead apatite

Paper • 2401.00999 • Published Jan 2 • 5

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 72

upvoted a paper 5 months ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 130

upvoted 2 collections 6 months ago

⭐ StarCoder

All models, datasets, and demos related to StarCoder! • 11 items • Updated Feb 27 • 19

Zephyr 7B

Models, datasets, and demos associated with Zephyr 7B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 9 items • Updated 21 days ago • 136

upvoted a paper 6 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

upvoted a paper 10 months ago

Llama 2: Open Foundation and Fine-Tuned Chat Models

Paper • 2307.09288 • Published Jul 18, 2023 • 233

upvoted a paper 11 months ago

RepoFusion: Training Code Models to Understand Your Repository

Paper • 2306.10998 • Published Jun 19, 2023 • 13