semvec/pypi-packages huggingface dataset:
tms-kit 0.4.1
Toolkit for running toy models of superposition experiments
License: MIT
Requires Python: >=3.11

# TMS

![tests](https://github.com/dtch1997/tms/actions/workflows/tests.yaml/badge.svg)

![5_2_superposition](experiments/bottleneck_tms/5_2_superposition.png)

Codebase for quickly implementing experiments with toy models of superposition. 

## Quickstart

To set up the environment, see [setup docs](docs/setup.md) for detailed instructions. 

To reproduce figures from Anthropic's [Toy Models of Superposition](https://transformer-circuits.pub/2022/toy_model/index.html), see [sample script](experiments/bottleneck_tms/run.py) 

## Acknowledgements

This codebase is heavily adapted from the [ARENA 3.0 codebase](https://github.com/callummcdougall/ARENA_3.0/tree/main), designed and maintained by Callum McDougall. Many thanks to Callum and the ARENA team!