Matt Mistele

mmistele's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted 6 papers 2 days ago

Aya 23: Open Weight Releases to Further Multilingual Progress

Paper • 2405.15032 • Published 7 days ago • 21

Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization

Paper • 2405.15071 • Published 7 days ago • 29

Trans-LoRA: towards data-free Transferable Parameter Efficient Finetuning

Paper • 2405.17258 • Published 3 days ago • 11

NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models

Paper • 2405.17428 • Published 3 days ago • 11

Transformers Can Do Arithmetic with the Right Embeddings

Paper • 2405.17399 • Published 3 days ago • 38

An Introduction to Vision-Language Modeling

Paper • 2405.17247 • Published 3 days ago • 61

upvoted a paper 6 days ago

DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data

Paper • 2405.14333 • Published 8 days ago • 27

upvoted 5 papers about 1 month ago

OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework

Paper • 2404.14619 • Published Apr 22 • 121

Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models

Paper • 2404.12387 • Published Apr 18 • 35

From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples

Paper • 2404.07544 • Published Apr 11 • 15

Learn Your Reference Model for Real Good Alignment

Paper • 2404.09656 • Published Apr 15 • 80

TransformerFAM: Feedback attention is working memory

Paper • 2404.09173 • Published Apr 14 • 42

upvoted 6 papers about 2 months ago

Best Practices and Lessons Learned on Synthetic Data for Language Models

Paper • 2404.07503 • Published Apr 11 • 25

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models

Paper • 2404.07839 • Published Apr 11 • 39

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Paper • 2404.07972 • Published Apr 11 • 41

Rho-1: Not All Tokens Are What You Need

Paper • 2404.07965 • Published Apr 11 • 80

Localizing Paragraph Memorization in Language Models

Paper • 2403.19851 • Published Mar 28 • 13

Jamba: A Hybrid Transformer-Mamba Language Model

Paper • 2403.19887 • Published Mar 28 • 99

upvoted 5 papers 3 months ago

Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking

Paper • 2403.09629 • Published Mar 14 • 54

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Paper • 2403.05530 • Published Mar 8 • 50

Large Language Models as Zero-shot Dialogue State Tracker through Function Calling

Paper • 2402.10466 • Published Feb 16 • 16

Chain-of-Thought Reasoning Without Prompting

Paper • 2402.10200 • Published Feb 15 • 91

Generative Representational Instruction Tuning

Paper • 2402.09906 • Published Feb 15 • 50

upvoted 4 papers 4 months ago

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Paper • 2402.00159 • Published Jan 31 • 55

OLMo: Accelerating the Science of Language Models

Paper • 2402.00838 • Published Feb 1 • 76

A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelism

Paper • 2401.05749 • Published Jan 11 • 6

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training

Paper • 2401.05566 • Published Jan 10 • 23

upvoted 2 papers 7 months ago

In-Context Learning Creates Task Vectors

Paper • 2310.15916 • Published Oct 24, 2023 • 39

DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines

Paper • 2310.03714 • Published Oct 5, 2023 • 27

upvoted 31 papers 10 months ago

Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification

Paper • 2308.07921 • Published Aug 15, 2023 • 20

CausalLM is not optimal for in-context learning

Paper • 2308.06912 • Published Aug 14, 2023 • 18

Self-Alignment with Instruction Backtranslation

Paper • 2308.06259 • Published Aug 11, 2023 • 38

BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents

Paper • 2308.05960 • Published Aug 11, 2023 • 18

Composable Function-preserving Expansions for Transformer Architectures

Paper • 2308.06103 • Published Aug 11, 2023 • 18

PIPPA: A Partially Synthetic Conversational Dataset

Paper • 2308.05884 • Published Aug 11, 2023 • 28

Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment

Paper • 2308.05374 • Published Aug 10, 2023 • 24

AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining

Paper • 2308.05734 • Published Aug 10, 2023 • 33

Shepherd: A Critic for Language Model Generation

Paper • 2308.04592 • Published Aug 8, 2023 • 27

Accelerating LLM Inference with Staged Speculative Decoding

Paper • 2308.04623 • Published Aug 8, 2023 • 20

SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore

Paper • 2308.04430 • Published Aug 8, 2023 • 9

Simple synthetic data reduces sycophancy in large language models

Paper • 2308.03958 • Published Aug 7, 2023 • 20

FLIRT: Feedback Loop In-context Red Teaming

Paper • 2308.04265 • Published Aug 8, 2023 • 12

Studying Large Language Model Generalization with Influence Functions

Paper • 2308.03296 • Published Aug 7, 2023 • 9

TPTU: Task Planning and Tool Usage of Large Language Model-based AI Agents

Paper • 2308.03427 • Published Aug 7, 2023 • 13

AgentBench: Evaluating LLMs as Agents

Paper • 2308.03688 • Published Aug 7, 2023 • 22

UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition

Paper • 2308.03279 • Published Aug 7, 2023 • 19

Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization

Paper • 2308.02151 • Published Aug 4, 2023 • 18

Exploring Format Consistency for Instruction Tuning

Paper • 2307.15504 • Published Jul 28, 2023 • 5

Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Paper • 2307.15217 • Published Jul 27, 2023 • 34

Skeleton-of-Thought: Large Language Models Can Do Parallel Decoding

Paper • 2307.15337 • Published Jul 28, 2023 • 34

Virtual Prompt Injection for Instruction-Tuned Large Language Models

Paper • 2307.16888 • Published Jul 31, 2023 • 5

The Hydra Effect: Emergent Self-repair in Language Model Computations

Paper • 2307.15771 • Published Jul 28, 2023 • 17

ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs

Paper • 2307.16789 • Published Jul 31, 2023 • 94

Tool Documentation Enables Zero-Shot Tool-Usage with Large Language Models

Paper • 2308.00675 • Published Aug 1, 2023 • 34

Skills-in-Context Prompting: Unlocking Compositionality in Large Language Models

Paper • 2308.00304 • Published Aug 1, 2023 • 22

SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning

Paper • 2308.00436 • Published Aug 1, 2023 • 20

From Sparse to Soft Mixtures of Experts

Paper • 2308.00951 • Published Aug 2, 2023 • 19

Scaling TransNormer to 175 Billion Parameters

Paper • 2307.14995 • Published Jul 27, 2023 • 21

How to Scale Your EMA

Paper • 2307.13813 • Published Jul 25, 2023 • 7

Measuring Faithfulness in Chain-of-Thought Reasoning

Paper • 2307.13702 • Published Jul 17, 2023 • 26