alpa (pypi): Alpa automatically parallelizes large tensor computation graphs and runs them on a distributed cluster.
Keywords: alpa|distributed|parallel|machine-learning|model-parallelismgpt-3|deep-learning|language-model|python|auto-parallelization|compiler|distributed-computing|distributed-training|high-performance-computing|jax|llm