GitHub repository: mouadenna/Token-Embedding-Visualizer
Primary language: Python
Description: A Streamlit application for visualizing and analyzing how different language models tokenize and embed text. This tool helps understand the differences between various tokenization approaches and their corresponding embedding spaces.