GitHub repository: martin-kukla/pre-tjax
Primary language: Python
Description: Transformers written from first principle in JAX/Torch.Func/Triton; Comparison of their training efficiency on 1GPU