File size: 569 Bytes
cb957d0
81b7b62
 
 
 
 
 
cb957d0
 
81b7b62
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
language: 
  - en
tags:
- text generation
- pytorch
- causal-lm
license: apache-2.0
---
# ReGPT-125M-200G
This model was trained on GPT-Neo-125M with [Mengzi Retrieval LM](https://github.com/Langboat/mengzi-retrieval-lm). 

For more details, please refer to this [document](https://github.com/Langboat/mengzi-retrieval-lm/blob/main/README.md).

# How to use
You have to use a forked transformers: https://github.com/Langboat/transformers
```python
from transformers import Re_gptForCausalLM
model = Re_gptForCausalLM.from_pretrained('Langboat/ReGPT-125M-200G')
```