Beren Millidge

BerenMillidge's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

updated a dataset about 1 month ago

Zyphra/dclm-dedup

Viewer • Updated Oct 24 • 615M • 3.62k • 10

New activity in Zyphra/Zamba2-2.7B-instruct about 2 months ago

fix ultrachat link in readme

#3 opened about 2 months ago by eliebak

authored 5 papers 4 months ago

BlackMamba: Mixture of Experts for State-Space Models

Paper • 2402.01771 • Published Feb 1 • 23

A Theoretical Framework for Inference Learning

Paper • 2206.00164 • Published Jun 1, 2022

A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks

Paper • 2212.00720 • Published Nov 16, 2022

Zyda: A 1.3T Dataset for Open Language Modeling

Paper • 2406.01981 • Published Jun 4 • 3

Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters

Paper • 2408.04093 • Published Aug 7 • 4

authored a paper 6 months ago

Zamba: A Compact 7B SSM Hybrid Model

Paper • 2405.16712 • Published May 26 • 22