GitHub repository: ofirpress/attention_with_linear_biases
Primary language: Python
Description: Code for our ALiBi method for transformer language models.