155 30 53

Leandro von Werra

lvwerra

https://github.com/lvwerra

AI & ML interests

NLP and RL

Articles

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

10 days ago

• 141

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Jun 18

• 33

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 70

Organizations

lvwerra's activity

upvoted an article 8 days ago

Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

10 days ago

• 141

upvoted an article 15 days ago

Article

Docmatix - a huge dataset for Document Visual Question Answering

15 days ago

• 54

upvoted an article 17 days ago

Article

SmolLM - blazingly fast and remarkably powerful

17 days ago

• 185

upvoted an article 29 days ago

Article

Our Transformers Code Agent beats the GAIA benchmark!

Jul 1

• 37

upvoted a paper 30 days ago

Agentless: Demystifying LLM-based Software Engineering Agents

Paper • 2407.01489 • Published Jul 1 • 42

upvoted 2 papers about 1 month ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25 • 77

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Paper • 2406.15877 • Published Jun 22 • 44

upvoted an article about 1 month ago

Article

Fine-tuning Florence-2 - Microsoft's Cutting-edge Vision Language Models

Jun 24

• 152

upvoted an article about 2 months ago

Article

Putting RL back in RLHF

Jun 12

• 56

upvoted a paper 2 months ago

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28 • 12

upvoted a collection 2 months ago

Leaderboards and benchmarks ✨

Collection

Cool leaderboard spaces collection for models across modalities! Text, vision, audio, ... • 66 items • Updated 14 days ago • 75

upvoted 3 articles 3 months ago

Article

2024-04-22 - Hub Incident Post Mortem

•

May 17

• 17

Article

License to Call: Introducing Transformers Agents 2.0

May 13

• 105

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 70

upvoted 2 papers 3 months ago

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Paper • 2402.09844 • Published Feb 15 • 20

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 243

upvoted an article 3 months ago

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 265

upvoted a paper 5 months ago

DoGE: Domain Reweighting with Generalization Estimation

Paper • 2310.15393 • Published Oct 23, 2023 • 1

upvoted a collection 5 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 78

upvoted a paper 5 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 129

upvoted a paper 6 months ago

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 140

upvoted a collection 7 months ago

Comparing DPO with IPO and KTO

Collection

A collection of chat models to explore the differences between three alignment techniques: DPO, IPO, and KTO. • 56 items • Updated Jan 9 • 31

upvoted 2 papers 7 months ago

Possible Meissner effect near room temperature in copper-substituted lead apatite

Paper • 2401.00999 • Published Jan 2 • 5

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 79

upvoted a paper 8 months ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 135

upvoted 2 collections 9 months ago

⭐ StarCoder

Collection

All models, datasets, and demos related to StarCoder! • 11 items • Updated Feb 27 • 20

Zephyr 7B

Collection

Models, datasets, and demos associated with Zephyr 7B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 9 items • Updated Apr 12 • 143

upvoted a paper 9 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 120

upvoted 2 papers about 1 year ago

Llama 2: Open Foundation and Fine-Tuned Chat Models

Paper • 2307.09288 • Published Jul 18, 2023 • 239

RepoFusion: Training Code Models to Understand Your Repository

Paper • 2306.10998 • Published Jun 19, 2023 • 14

Leandro von Werra

AI & ML interests

Articles

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Welcome Llama 3 - Meta's new open LLM

StarCoder2 and The Stack v2

Constitutional AI with Open LLMs

Preference Tuning LLMs with Direct Preference Optimization Methods

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

The N Implementation Details of RLHF with PPO

Finetune Stable Diffusion Models with DDPO via TRL

Spread Your Wings: Falcon 180B is here

Code Llama: Llama 2 learns to code

Fine-tune Llama 2 with DPO

The Falcon has landed in the Hugging Face ecosystem

Creating a Coding Assistant with StarCoder

StarCoder: A State-of-the-Art LLM for Code

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Evaluating Language Model Bias with 🤗 Evaluate

Announcing Evaluation on the Hub

Organizations

lvwerra's activity

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Docmatix - a huge dataset for Document Visual Question Answering

SmolLM - blazingly fast and remarkably powerful

Our Transformers Code Agent beats the GAIA benchmark!

Fine-tuning Florence-2 - Microsoft's Cutting-edge Vision Language Models

Putting RL back in RLHF

2024-04-22 - Hub Incident Post Mortem

License to Call: Introducing Transformers Agents 2.0

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Welcome Llama 3 - Meta's new open LLM