Shuming Ma's picture

12 7 3

Shuming Ma

shumingma

·

shumingma

AI & ML interests

None yet

Recent Activity

authored a paper 22 days ago

BitNet v2: Native 4-bit Activations with Hadamard Transformation for 1-bit LLMs

new activity 23 days ago

microsoft/bitnet-b1.58-2B-4T:Eval numbers for Llama 3.2 1B in Table 1 don't match Meta's results

new activity 28 days ago

microsoft/bitnet-b1.58-2B-4T:Important confirmation: about the deviation from the model that was originally uploaded

View all activity

Organizations

shumingma's activity

upvoted 2 papers about 1 month ago

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 102

BitNet b1.58 2B4T Technical Report

Paper • 2504.12285 • Published Apr 16 • 72

upvoted a collection about 1 month ago

BitNet

🔥BitNet family of large language models (1-bit LLMs). • 7 items • Updated 21 days ago • 39

upvoted a paper 6 months ago

BitNet a4.8: 4-bit Activations for 1-bit LLMs

Paper • 2411.04965 • Published Nov 7, 2024 • 69

upvoted an article 8 months ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

By

and 5 others •

Sep 18, 2024

• 244

upvoted a paper 10 months ago

Q-Sparse: All Large Language Models can be Fully Sparsely-Activated

Paper • 2407.10969 • Published Jul 15, 2024 • 23

upvoted a paper about 1 year ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 617