Hugging Face's logo

Spaces:
sail
/
zero-bubble-pipeline-parallellism
Running

App Files Community
Wan Xinyi commited on
Commit
de3347f
•
1 Parent(s): c47cbb6

Update paper link

Browse files
Files changed (1) hide show
  1. description1.md +3 -1
description1.md CHANGED
@@ -2,7 +2,9 @@
2
 
3
  Zero Bubble Pipeline Parallelism is a novel pipeline parallelism algorithm able to reduce the bubble of pipeline parallelism to almost zero while preserving synchronous semantics.
4
 
5
- Our paper is coming soon.
 
 
6
 
7
  Try out our implementation based on Megatron on [https://github.com/sail-sg/zero-bubble-pipeline-parallelism](https://github.com/sail-sg/zero-bubble-pipeline-parallelism)
8
 
 
2
 
3
  Zero Bubble Pipeline Parallelism is a novel pipeline parallelism algorithm able to reduce the bubble of pipeline parallelism to almost zero while preserving synchronous semantics.
4
 
5
+ Check out our paper at:
6
+ * [Arxiv Version with ZBV](https://arxiv.org/abs/2401.10241)
7
+ * [ICLR Accepted version with ZB1P and ZB2P](https://openreview.net/pdf?id=tuzTN0eIO5)
8
 
9
  Try out our implementation based on Megatron on [https://github.com/sail-sg/zero-bubble-pipeline-parallelism](https://github.com/sail-sg/zero-bubble-pipeline-parallelism)
10