GitHub repository: ApolloResearch/gpt2_noLN
Primary language: Python
Description: A GPT2 fine-tuning script to remove LayerNorm layers. Based on karpathy/nanoGPT