GitHub repository: kyegomez/JaxTransformer
Primary language: Python
Created: 2024-09-07T21:21:45Z
Description: This repository demonstrates how to build a Decoder-Only Transformer with Multi-Query Attention in JAX.