---
license: apache-2.0
datasets:
- EleutherAI/the_pile
---
This model is part of an intervention study done in the paper [Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling](https://arxiv.org/abs/2304.01373) where we replaced all masculine pronouns with femanine ones and retrained the model for the last 21 billion tokens. The corresponding regular model can be found [here](https://huggingface.co/EleutherAI/pythia-1.4b-deduped).

**We do not recommend using this model for any purpose other than to study the influence of gender pronouns on language model behavior.**