hivemind

non-profit

https://training-transformers-together.github.io

learning-at-home

Activity Feed Request to join this org

AI & ML interests

Distributed training over the internet

Recent Activity

yhn112 authored a paper 6 months ago

Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees

yhn112 authored a paper 6 months ago

Secure Distributed Training at Scale

yhn112 authored a paper 6 months ago

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

View all activity

Organization Card

Community About org cards

We're training large transformers together over the internet. More information will be added shortly

models 1

hivemind/gpt-j-6B-8bit

Text Generation • Updated Oct 18, 2022 • 194 • 131

datasets

None public yet