hivemind

non-profit

https://training-transformers-together.github.io

learning-at-home

Activity Feed Request to join this org

AI & ML interests

Distributed training over the internet

Recent Activity

yhn112 authored a paper 6 months ago

Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees

yhn112 authored a paper 6 months ago

Secure Distributed Training at Scale

yhn112 authored a paper 6 months ago

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

View all activity

hivemind's activity

yhn112

authored 6 papers 6 months ago

Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees

Paper • 2110.03313 • Published Oct 7, 2021 • 1

Secure Distributed Training at Scale

Paper • 2106.11257 • Published Jun 21, 2021

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

Paper • 2301.11913 • Published Jan 27, 2023 • 1

Distributed Deep Learning in Open Collaborations

Paper • 2106.10207 • Published Jun 18, 2021 • 2

Training Transformers Together

Paper • 2207.03481 • Published Jul 7, 2022 • 5

A critical look at the evaluation of GNNs under heterophily: Are we really making progress?

Paper • 2302.11640 • Published Feb 22, 2023

borzunov

authored a paper about 1 year ago

Distributed Inference and Fine-tuning of Large Language Models Over The Internet

Paper • 2312.08361 • Published Dec 13, 2023 • 25

justheuristic

updated a model about 2 years ago

hivemind/gpt-j-6B-8bit

Text Generation • Updated Oct 18, 2022 • 194 • 131