27 31 58

Marc Sun

marcsun13

AI & ML interests

LLM, Quantization, Training, Inference

Articles

Organizations

marcsun13's activity

upvoted an article about 2 months ago

Article

Benchmarking Text Generation Inference

May 29

• 26

upvoted a paper about 2 months ago

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28 • 12

upvoted an article about 2 months ago

Article

License to Call: Introducing Transformers Agents 2.0

May 13

• 102

upvoted a paper 3 months ago

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 96

upvoted an article 3 months ago

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 261

upvoted a collection 3 months ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated Apr 18 • 646

upvoted 10 articles 3 months ago

Article

Vision Language Models Explained

Apr 11

• 138

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 149

Article

Overview of natively supported quantization schemes in 🤗 Transformers

Sep 12, 2023

• 8

Article

Making LLMs lighter with AutoGPTQ and transformers

Aug 23, 2023

• 16

Article

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

Aug 17, 2022

• 34

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 54

Article

Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval

Mar 22

• 48

Article

quanto: a pytorch quantization toolkit

Mar 18

• 25

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 22

Article

Outpainting II - Differential Diffusion

•

Apr 23

• 33

upvoted 2 papers 4 months ago

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

Paper • 2402.02750 • Published Feb 5 • 3

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Paper • 2403.09029 • Published Mar 14 • 54

upvoted 3 papers 5 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 126

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 581

BiLLM: Pushing the Limit of Post-Training Quantization for LLMs

Paper • 2402.04291 • Published Feb 6 • 48

upvoted 2 papers 6 months ago

Mixtral of Experts

Paper • 2401.04088 • Published Jan 8 • 156

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 84

upvoted a paper 7 months ago

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 255

upvoted a collection 7 months ago

BLIP models

Collection

A collection of all BLIP models • 8 items • Updated 3 days ago • 16

upvoted a paper 7 months ago

ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks

Paper • 2312.08583 • Published Dec 14, 2023 • 9

upvoted 2 papers 8 months ago

Effective Quantization for Diffusion Models on CPUs

Paper • 2311.16133 • Published Nov 2, 2023 • 4

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 120

upvoted a collection 10 months ago

Recent models: last 100 repos, sorted by creation date

Collection

The last 100 repos I have created. Sorted by creation date descending, so the most recently created repos appear at the top. • 121 items • Updated Jan 31 • 467

upvoted 2 papers 12 months ago

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 40

GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

Paper • 2210.17323 • Published Oct 31, 2022 • 6