RedPajama: an Open Dataset for Training Large Language Models
Paper
•
2411.12372
•
Published
•
47
NCAI-CALM
non-profit
AI & ML interests
Training Arabic BERT collaboratively over the internet
Recent Activity
View all activity
CALM's activity
mryab
authored
a
paper
about 1 month ago
yhn112
authored
a
paper
7 months ago
mryab
authored
a
paper
7 months ago
yhn112
authored
5
papers
7 months ago
Secure Distributed Training at Scale
Paper
•
2106.11257
•
Published
SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient
Paper
•
2301.11913
•
Published
•
1
Distributed Deep Learning in Open Collaborations
Paper
•
2106.10207
•
Published
•
2
Training Transformers Together
Paper
•
2207.03481
•
Published
•
5
A critical look at the evaluation of GNNs under heterophily: Are we really making progress?
Paper
•
2302.11640
•
Published
mryab
authored
5
papers
8 months ago
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Paper
•
2211.05100
•
Published
•
27
RuCoLA: Russian Corpus of Linguistic Acceptability
Paper
•
2210.12814
•
Published
•
1
Petals: Collaborative Inference and Fine-tuning of Large Models
Paper
•
2209.01188
•
Published
•
2
Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding
Paper
•
2402.12374
•
Published
•
3
The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Models
Paper
•
2404.05904
•
Published
•
8
Zaid
authored
4
papers
11 months ago
ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic
Paper
•
2402.12840
•
Published
•
1
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
Paper
•
2202.01279
•
Published
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP
Paper
•
2112.10508
•
Published
Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources
Paper
•
2201.10066
•
Published
mryab
authored
a
paper
11 months ago
Zaid
authored
2
papers
11 months ago