Sparsing Law: Towards Large Language Models with Greater Activation Sparsity
Paper
•
2411.02335
•
Published
•
11
PowerInfer
community
AI & ML interests
We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.
Recent Activity
View all activity
PowerInfer's activity
Raincleared
authored
a
paper
about 2 months ago
Raincleared
authored
a
paper
4 months ago
yixinsong
updated
3
models
6 months ago
yixinsong
authored
3
papers
6 months ago
Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters
Paper
•
2406.05955
•
Published
•
22
ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs
Paper
•
2402.03804
•
Published
•
2
PowerInfer-2: Fast Large Language Model Inference on a Smartphone
Paper
•
2406.06282
•
Published
•
36
yzmizeyu
authored
3
papers
6 months ago
ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs
Paper
•
2402.03804
•
Published
•
2
Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters
Paper
•
2406.05955
•
Published
•
22
PowerInfer-2: Fast Large Language Model Inference on a Smartphone
Paper
•
2406.06282
•
Published
•
36
yixinsong
updated
2
models
7 months ago
hodlen
updated
3
models
9 months ago
yixinsong
updated
a
dataset
9 months ago
Raincleared
updated
2
models
10 months ago
yzmizeyu
authored
a
paper
about 1 year ago