alpa-projects/alpa: Training and serving large-scale neural networks with auto parallelization.
Category: ml-dl
Language: Python
Topics: alpa, auto-parallelization, compiler, deep-learning, distributed-computing, distributed-training, high-performance-computing, jax, llm, machine-learning
Homepage: https://alpa.ai