Hendrycks, Dan, Mantas Mazeika, and Thomas Woodside (2023). An Overview of Catastrophic AI Risks. arXiv: 2306.12001 [cs.CY].
Hernandez, Evan, Sarah Schwettmann, David Bau, Teona Bagashvili, Antonio Torralba, and Jacob Andreas (2022). Natural Language Descriptions of Deep Visual Features. arXiv: 2201.11114 [cs.CV].
Hubinger, Evan (2020). An overview of 11 proposals for building safe advanced AI. arXiv: 2012. 07532 [cs.LG].
Jacovi, Alon and Yoav Goldberg (2020). "Towards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?" In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Online: Association for Computational Linguistics, pp. 4198-4205. DOI: 10.18653/v1/2020.acl-main.386. URL: https://aclanthology.org/2020.acl-main.386.
Jang, Eric, Shixiang Gu, and Ben Poole (2017). Categorical Reparameterization with Gumbel-Softmax. arXiv: 1611.01144 [stat.ML].
Kaddour, Jean, Aengus Lynch, Qi Liu, Matt J. Kusner, and Ricardo Silva (2022). Causal Machine Learning: A Survey and Open Problems. URL: https://arxiv.org/abs/2206.15475.
Kaplan, Jared, Sam McCandlish, Tom Henighan, Tom B. Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei (2020). Scaling Laws for Neural Language Models. arXiv: 2001.08361 [cs.LG].
Kurtic, Eldar, Daniel Campos, Tuan Nguyen, Elias Frantar, Mark Kurtz, Benjamin Fineran, Michael Goin, and Dan Alistarh (2022). "The optimal BERT surgeon: Scalable and accurate second-order pruning for large language models". In.
LeCun, Yann, John Denker, and Sara Solla (1989). "Optimal brain damage". In: 2.
Lindner, David, János Kramár, Matthew Rahtz, Thomas McGrath, and Vladimir Mikulik (2023). "Tracr: Compiled Transformers as a Laboratory for Interpretability". In.
Lipton, Zachary C. (2016). The Myth of Model Interpretability. URL: https://arxiv.org/abs/1606.03490.
Louizos, Christos, Max Welling, and Diederik P. Kingma (2018). "Learning Sparse Neural Networks through L_0 Regularization". In: 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net. URL: https://openreview.net/forum?id=H1Y8hhg0b.
Mathwin, Chris, Guillaume Corlouer, Esben Kran, Fazl Berez, and Neel Nanda (2023). Identifying a Preliminary Circuit for Predicting Gendered Pronouns in GPT-2 Small. URL: https://itch.io/jam/mechint/rate/1889871.
McDougall, Callum, Arthur Conmy, Cody Rushing, Thomas McGrath, and Neel Nanda (2023). Copy Suppression: Comprehensively Understanding an Attention Head. arXiv: 2310.04625 [cs.LG].
Meng, Kevin, David Bau, Alex J Andonian, and Yonatan Belinkov (2022). "Locating and editing factual associations in GPT". In: Advances in Neural Information Processing Systems.
Michel, Paul, Omer Levy, and Graham Neubig (2019). "Are Sixteen Heads Really Better than One?" In: Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada. Ed. by Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d'Alché-Buc, Emily B. Fox, and Roman Garnett, pp. 14014-14024. URL: https://proceedings.neurips.cc/paper/2019混沌/2c601ad9d2ff9bc8b282670cdb54f69f-AAbstract.html.
Mu, Jesse and Jacob Andreas (2021). *Compositional Explanations of Neurons*. arXiv: 2006.14032 [cs.LG].
Nanda, Neel (2022). TransformerLens. URL: https://github.com/neelnanda-io/TransformerLens.
- (2023). Attribution Patching: Activation Patching At Industrial Scale. URL: https://www.neelnanda.io/mechanistic-interpretability/attribute-patching.
Nanda, Neel, Lawrence Chan, Tom Lieberum, Jess Smith, and Jacob Steinhardt (2023). "Progress measures for grokking via mechanistic interpretability". In: The Eleventh International Conference on Learning Representations. URL: https://openreview.net/forum?id=9XFSbDPmdW.
Olah, Chris (2022). Mechanistic Interpretability, Variables, and the Importance of Interpretable Bases. https://www.transformer-circuits.pub/2022/mech-interp-essay.
Olah, Chris, Alexander Mordvintsev, and Ludwig Schubert (2017). "Feature Visualization". In: Distill. https://distill.pub/2017/feature-visualization. DOI: 10.23915/distill.00007.
Olsson, Catherine, Nelson Elhage, Neel Nanda, Nicholas Joseph, Nova DasSarma, Tom Henighan, Ben Mann, Amanda Askell, Yuntao Bai, Anna Chen, et al. (2022). In-context learning and induction