GitHub repository: mwatkins1970/alphabetical_probe
Primary language: Jupyter Notebook
Created: 2023-09-23T00:57:52Z
Description: Experimental code which trains 26 linear probes to detect the presence of alphabetic letters in GPT-J token strings, given their embeddings. Exploring the resulting vector arithmetic and its impact on GPT-J spelling abilities