Nathan Lambert's picture

Nathan Lambert

natolambert

·

https://www.natolambert.com/

AI & ML interests

Reinforcement learning, Ethics, Robotics, Dynamics Models

Articles

Ethics and Society Newsletter #4: Bias in Text-to-Image Models

Can foundation models label data like humans?

Creating a Coding Assistant with StarCoder

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Red-Teaming Large Language Models

What Makes a Dialog Agent Useful?

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Stable Diffusion with 🧨 Diffusers

Organizations

natolambert's activity

upvoted a collection 20 days ago

[lecture artifacts] aligning open language models

artifacts referenced in the talk timeline! Slides: https://docs.google.com/presentation/d/1quMyI4BAx4rvcDfk8jjv063bmHg4RxZd9mhQloXpMn0/edit?usp=sharin • 63 items • Updated 15 days ago • 39

upvoted a collection about 1 month ago

Reward Bench

Datasets, spaces, and models for the reward model benchmark! • 4 items • Updated Mar 20 • 2

upvoted a collection 2 months ago

Gemma release

Groups the Gemma models released by the Google team. • 40 items • Updated 21 days ago • 288

upvoted 2 collections 3 months ago

Model Merging

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 28 items • Updated Mar 23 • 172

OLMo Suite

Artifacts for the first set of OLMo models. • 12 items • Updated 9 days ago • 34

upvoted a collection 4 months ago

Deita

12 items • Updated Dec 20, 2023 • 7

upvoted 4 collections 5 months ago

Awesome feedback datasets

A curated list of datasets with human or AI feedback. Useful for training reward models or applying techniques like DPO. • 19 items • Updated 21 days ago • 52

Awesome SFT datasets

A curated list of interesting datasets to fine-tune language models with. • 43 items • Updated 21 days ago • 88

MoE

129 items • Updated 8 days ago • 16

Journal Club

Candidate papers to read in the H4 journal club • 54 items • Updated 11 days ago • 23

upvoted a collection 6 months ago

Tulu V2 Suite

The set of models associated with the paper "Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2" • 19 items • Updated Feb 1 • 43

upvoted a paper 6 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

upvoted a collection 6 months ago

Zephyr 7B

Models, datasets, and demos associated with Zephyr 7B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 9 items • Updated 21 days ago • 136