2 16 155

PeijieDong

pprp

https://pprp.github.io

AI & ML interests

Model Compression; Large Language Model;

Recent Activity

liked a model 12 days ago

strangerzonehf/Flux-Sketch-Flat-LoRA

liked a Space 14 days ago

huggingface/paper-central

liked a model 18 days ago

microsoft/Phi-3-small-8k-instruct

View all activity

Organizations

None yet

pprp's activity

upvoted 3 papers 2 months ago

Should We Really Edit Language Models? On the Evaluation of Edited Language Models

Paper • 2410.18785 • Published Oct 24 • 5

FlatQuant: Flatness Matters for LLM Quantization

Paper • 2410.09426 • Published Oct 12 • 12

DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads

Paper • 2410.10819 • Published Oct 14 • 6

upvoted 4 papers 3 months ago

LPZero: Language Model Zero-cost Proxy Search from Zero

Paper • 2410.04808 • Published Oct 7 • 2

Benchmarking Agentic Workflow Generation

Paper • 2410.07869 • Published Oct 10 • 25

PrefixQuant: Static Quantization Beats Dynamic through Prefixed Outliers in LLMs

Paper • 2410.05265 • Published Oct 7 • 29

LongGenBench: Long-context Generation Benchmark

Paper • 2410.04199 • Published Oct 5 • 17

upvoted an article 4 months ago

Article

LLM Data Engineering 3——Data Collection Magic: Acquiring Top Training Data

•

Jun 4

• 4

upvoted a collection 5 months ago

Google Gemma2

Collection

24 items • Updated Oct 22 • 15

upvoted an article 5 months ago

Article

Welcome Gemma 2 - Google's new open LLM

Jun 27

• 124

upvoted a collection 5 months ago

🪐 SmolLM

Collection

A series of smol LLMs: 135M, 360M and 1.7B. We release base and Instruct models as well as the training corpus and some WebGPU demos • 12 items • Updated 4 days ago • 204

upvoted a paper 5 months ago

Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models

Paper • 2406.02924 • Published Jun 5 • 2

upvoted an article 7 months ago

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 102

upvoted a paper 11 months ago

Shortened LLaMA: A Simple Depth Pruning for Large Language Models

Paper • 2402.02834 • Published Feb 5 • 14

upvoted a collection 11 months ago

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12 • 218