Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova (2019). "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding". In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Minneapolis, Minnesota: Association for Computational Linguistics, pp. 4171-4186. DOI: 10.18653/v1/N19-1423. URL: https://aclanthology.org/N19-1423.
Elhage, Nelson, Tristan Hume, Catherine Olsson, Nicholas Schiefer, Tom Henighan, Shauna Kravec, Zac Hatfield-Dodds, Robert Lasenby, Dawn Drain, Carol Chen, et al. (2022). "Toy Models of Superposition". In: arXiv preprint arXiv:2209.10652.
Elhage, Nelson, Neel Nanda, Catherine Olsson, Tom Henighan, Nicholas Joseph, Ben Mann, Amanda Askell, Yuntao Bai, Anna Chen, Tom Conerly, Nova DasSarma, Dawn Drain, Deep Ganguli, Zac Hatfield-Dodds, Danny Hernandez, Andy Jones, Jackson Kernion, Liane Lovitt, Kamal Ndousse, Dario Amodei, Tom Brown, Jack Clark, Jared Kaplan, Sam McCandlish, and Chris Olah (2021). "A Mathematical Framework for Transformer Circuits". In: Transformer Circuits Thread. URL: https://transformer-circuits.pub/2021/framework/index.html.
Fawcett, Tom (2006). "An introduction to ROC analysis". In: Pattern Recognition Letters 27.8. ROC Analysis in Pattern Recognition, pp. 861-874. ISSN: 0167-8655. DOI: https://doi.org/10.1016/j.patrec.2005.10.010. URL: https://www.sciencedirect.com/science/article/pii/S016786550500303X.
Feder, Amir, Nadav Oved, Uri Shalit, and Roi Reichart (2021). "CausaLM: Causal Model Explanation Through Counterfactual Language Models". In: Computational Linguistics 47.2, pp. 333-386. DOI: 10.1162/coli_a_00404. URL: https://aclanthology.org/2021.cl-2.13.
Fong, Ruth C. and Andrea Vedaldi (2017). "Interpretable Explanations of Black Boxes by Meaningful Perturbation". In: IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017. IEEE Computer Society, pp. 3449-3457. DOI: 10.1109/ICCV.2017.371. URL: https://doi.org/10.1109/ICCV.2017.371.
Frantar, Elias and Dan Alistarh (2023). SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot.
Fu, Daniel Y, Tri Dao, Khaled Kamal Saab, Armin W Thomas, Atri Rudra, and Christopher Re (2023). "Hungry Hungry Hippos: Towards Language Modeling with State Space Models". In: The Eleventh International Conference on Learning Representations. URL: https://openreview.net/forum?id=COZDyOWYGg.
Geiger, Atticus, Hanson Lu, Thomas Icard, and Christopher Potts (2021). Causal Abstractions of Neural Networks. URL: https://arxiv.org/abs/2106.02997.
Geva, Mor, Roei Schuster, Jonathan Berant, and Omer Levy (2021). "Transformer Feed-Forward Layers Are Key-Value Memories". In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Online and Punta Cana, Dominican Republic: Association for Computational Linguistics, pp. 5484-5495. DOI: 10.18653/v1/2021.emnlp-main.446. URL: https://aclanthology.org/2021.emnlp-main.446.
Gokaslan, Aaron, Vanya Cohen, Ellie Pavlick, and Stefanie Tellex (2019). OpenWebText Corpus. URL: https://Skylion007.github.io/OpenWebTextCorpus.
Goldowsky-Dill, Nicholas, Chris MacLeod, Lucas Sato, and Aryaman Arora (2023). Localizing Model Behavior with Path Patching. arXiv: 2304.05969 [cs.LG].
Grover, Jasdeep Singh, Bhavesh Gawri, and Ruskin Raj Manku (2022). "DeepCuts: Single-Shot Interpretability based Pruning for BERT". In.
Gurnee, Wes, Neel Nanda, Matthew Pauly, Katherine Harvey, Dmitrii Troitskii, and Dimitris Bertsi-mas (2023). Finding Neurons in a Haystack: Case Studies with Sparse Probing. arXiv: 2305.01610 [cs.LG].
Hanna, Michael, Ollie Liu, and Alexandre Variengien (2023). How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model. arXiv: 2305.00586 [cs.CL].
Hassibi, Babak and David Stork (1992). "Second order derivatives for network pruning: Optimal brain surgeon". In: 5.
Heimersheim, Stefan and Jett Janiak (2023). A circuit for Python docstrings in a 4-layer attention-only transformer. URL: https://wwwalignmentforum.org/posts/u6KXXmKFbXfWzoAXn/a-circuit-for-python-docstrings-in-a-4-layer-attention-only.
Hendrycks, Dan and Mantas Mazeika (2022). X-Risk Analysis for AI Research. arXiv: 2206.05862 [cs.CY].