| license: apache-2.0 | |
| datasets: | |
| - EleutherAI/the_pile | |
| This model is part of an intervention study done in the paper [Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling](https://arxiv.org/abs/2304.01373) where we replaced all masculine pronouns with femanine ones and retrained the model for the last 63 billion tokens. The regular model can be found [here](https://huggingface.co/EleutherAI/pythia-1.4b-deduped). | |
| **We do not recommend using this model for any purpose other than to study the influence of gender pronouns on language model behavior.** |