fpreiss (Fabian A. Preiß)

upvoted an article 2 months ago

Article

How we leveraged distilabel to create an Argilla 2.0 Chatbot

Jul 16

• 30

upvoted a paper 3 months ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20 • 85

upvoted 5 papers 5 months ago

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published Apr 29 • 68

ChatQA: Building GPT-4 Level Conversational QA Models

Paper • 2401.10225 • Published Jan 18 • 32

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Paper • 2404.03715 • Published Apr 4 • 59

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 250

MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

Paper • 2402.14905 • Published Feb 22 • 107

upvoted an article 5 months ago

Article

Fine-tune Llama 3 with ORPO

By

•

Apr 22

• 219

upvoted a collection 5 months ago

fuck quadratic attention

Collection

11 items • Updated Apr 24 • 20

upvoted 4 papers 5 months ago

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Paper • 2310.06770 • Published Oct 10, 2023 • 4

Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

Paper • 2403.12881 • Published Mar 19 • 16

Advancing LLM Reasoning Generalists with Preference Trees

Paper • 2404.02078 • Published Apr 2 • 43

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published Apr 4 • 86

upvoted a paper 6 months ago

Lost in the Middle: How Language Models Use Long Contexts

Paper • 2307.03172 • Published Jul 6, 2023 • 35

upvoted 2 collections 6 months ago

MoEs papers reading list

Collection

56 items • Updated 20 days ago • 132

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12 • 210

upvoted a collection 7 months ago

Leaderboards and benchmarks ✨

Collection

Cool leaderboard spaces collection for models across modalities! Text, vision, audio, ... • 67 items • Updated Aug 6 • 83

upvoted a collection 8 months ago

Tiny Series

Collection

Tiny datasets that empower the foundation of Small Language Model! • 11 items • Updated Jan 26 • 34

Fabian A. Preiß

AI & ML interests

Organizations

fpreiss's activity

How we leveraged distilabel to create an Argilla 2.0 Chatbot

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

ChatQA: Building GPT-4 Level Conversational QA Models

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

Fine-tune Llama 3 with ORPO

fuck quadratic attention

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

Advancing LLM Reasoning Generalists with Preference Trees

ReFT: Representation Finetuning for Language Models

Lost in the Middle: How Language Models Use Long Contexts

MoEs papers reading list

Model Merging

Leaderboards and benchmarks ✨

Tiny Series