Sleeping
2
🏢
Mike Smith
Smith42
AI & ML interests
AI applied to big observational datasets
Recent Activity
liked
a Space
4 days ago
UniverseTBD/astroLLaVA
authored
a paper
14 days ago
The Multimodal Universe: Enabling Large-Scale Machine Learning with
100TB of Astronomical Scientific Data
Organizations
Smith42's activity
liked
a
Space
4 days ago
authored
a
paper
14 days ago
upvoted
a
paper
14 days ago
authored
a
paper
3 months ago
liked
a
Space
4 months ago
authored
3
papers
7 months ago
2100M Param Model
#2 opened 7 months ago
by
RJRoberts
RJRoberts
updated
2
models
7 months ago
updated
a
dataset
7 months ago
[bot] Conversion to Parquet
#1 opened 9 months ago
by
parquet-converter
parquet-converter
Is there a leaderboard for model performance for this?
#2 opened 7 months ago
by
Smith42
Smith42
liked
a
dataset
8 months ago
upvoted
a
collection
8 months ago
reacted to
shumingma's
post with 🚀
9 months ago
Post
2642
The Era of 1-bit LLMs: Training Tips, Code and FAQ
https://github.com/microsoft/unilm/blob/master/bitnet/The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ.pdf
We present details and tips for training 1-bit LLMs. We also provide additional experiments and results that were not reported and responses to questions regarding the "The-Era-of-1-bit-LLM" paper. Finally, we include the official PyTorch implementation of BitNet (b1.58 and b1) for future research and development of 1-bit LLMs.
https://github.com/microsoft/unilm/blob/master/bitnet/The-Era-of-1-bit-LLMs__Training_Tips_Code_FAQ.pdf
We present details and tips for training 1-bit LLMs. We also provide additional experiments and results that were not reported and responses to questions regarding the "The-Era-of-1-bit-LLM" paper. Finally, we include the official PyTorch implementation of BitNet (b1.58 and b1) for future research and development of 1-bit LLMs.
- 2 replies
updated
a
Space
9 months ago
liked
a
model
9 months ago
liked
a
dataset
10 months ago