---
language: 
  - en
tags:
- text generation
- pytorch
- causal-lm
license: apache-2.0
---
# ReGPT-125M-200G
This model was trained on GPT-Neo-125M with [Mengzi Retrieval LM](https://github.com/Langboat/mengzi-retrieval-lm). 

For more details, please refer to this [document](https://github.com/Langboat/mengzi-retrieval-lm/blob/main/README.md).

# How to use
You have to use a forked transformers: https://github.com/Langboat/transformers
```python
from transformers import Re_gptForCausalLM
model = Re_gptForCausalLM.from_pretrained('Langboat/ReGPT-125M-200G')
```