GitHub repository: keenanpepper/self-ablating-transformers
Primary language: Jupyter Notebook
Created: 2024-08-17T03:05:40Z
Description: A self-modeling transformer with an auxiliary output head that is an ablation mask for itself, in a second forward pass