PenutChen

penut85420's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a paper about 1 month ago

LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning

Paper • 2403.17919 • Published Mar 26 • 15

upvoted 2 papers about 2 months ago

You Need to Pay Better Attention

Paper • 2403.01643 • Published Mar 3 • 1

Adding NVMe SSDs to Enable and Accelerate 100B Model Fine-tuning on a Single GPU

Paper • 2403.06504 • Published Mar 11 • 52

upvoted a paper 2 months ago

Divide-or-Conquer? Which Part Should You Distill Your LLM?

Paper • 2402.15000 • Published Feb 22 • 22

upvoted a collection 2 months ago

Canonical models

Collection

This collection lists all the historical (pre-"Hub") canonical model checkpoints, i.e. repos that were not under an org or user namespace • 68 items • Updated Feb 13 • 13

upvoted a paper 2 months ago

Fast Vocabulary Transfer for Language Model Compression

Paper • 2402.09977 • Published Feb 15 • 2

upvoted 2 papers 3 months ago

Anchor-based Large Language Models

Paper • 2402.07616 • Published Feb 12 • 1

DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Paper • 2401.14196 • Published Jan 25 • 42

upvoted 5 papers 4 months ago

MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts

Paper • 2401.04081 • Published Jan 8 • 68

Mixtral of Experts

Paper • 2401.04088 • Published Jan 8 • 152

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

Paper • 2401.02954 • Published Jan 5 • 38

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 80

YAYI 2: Multilingual Open-Source Large Language Models

Paper • 2312.14862 • Published Dec 22, 2023 • 11

upvoted a paper 5 months ago

Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision

Paper • 2312.09390 • Published Dec 14, 2023 • 32

upvoted a paper 6 months ago

LLM-FP4: 4-Bit Floating-Point Quantized Transformers

Paper • 2310.16836 • Published Oct 25, 2023 • 10