Generate.py doesn't support gpt-j
Author: randywreed
Pull request: no
Labels: name: bug

### System Info

```shell
- `transformers` version: 4.20.0.dev0
- Platform: Linux-5.4.0-110-generic-x86_64-with-glibc2.31
- Python version: 3.9.7
- Huggingface_hub version: 0.6.0
- PyTorch version (GPU?): 1.11.0+cu102 (True)
- Tensorflow version (GPU?): 2.9.0 (False)
- Flax version (CPU?/GPU?/TPU?): 0.4.2 (cpu)
- Jax version: 0.3.6
- JaxLib version: 0.3.5
- Using GPU in script?: yes
- Using distributed or parallel set-up in script?: no
```


### Who can help?

@sgugger @pat

### Information

- [X] The official example scripts
- [ ] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [X] My own task or dataset (give details below)

### Reproduction

run_generation.py --model_type gpt2 --model_name_or_path "EleutherAI/gpt-j-6B" --prompt "Hello I am" --length 100
```
Some weights of the model checkpoint at gpt-j-6B/ were not used when initializing GPT2LMHeadModel: ['transformer.h.5.mlp.fc_in.weight', 'transformer.h.10.attn.v_proj.weight', 'transformer.h.8.mlp.fc_in.bias', 'transformer.h.3.attn.v_proj.weight', 'transformer.h.18.mlp.fc_out.bias', 'transformer.h.13.mlp.fc_in.weight', 'transformer.h.1.attn.v_proj.weight', 'transformer.h.0.attn.q_proj.weight', 'transformer.h.12.attn.k_proj.weight', 'transformer.h.4.attn.v_proj.weight', 'transformer.h.22.mlp.fc_out.weight', 'transformer.h.13.attn.out_proj.weight', 'transformer.h.15.mlp.fc_in.bias', 'transformer.h.14.attn.k_proj.weight', 'transformer.h.26.mlp.fc_out.weight', 'transformer.h.12.attn.q_proj.weight', 'transformer.h.25.mlp.fc_out.bias', 'transformer.h.9.attn.q_proj.weight', 'transformer.h.7.attn.q_proj.weight', 'transformer.h.14.mlp.fc_in.weight', 'transformer.h.16.mlp.fc_out.bias', 'transformer.h.2.mlp.fc_out.bias', 'transformer.h.6.mlp.fc_in.weight', 'transformer.h.22.mlp.fc_in.weight', 'transformer.h.19.mlp.fc_out.bias', 'transformer.h.25.attn.k_proj.weight', 'transformer.h.15.attn.q_proj.weight', 'transformer.h.22.attn.q_proj.weight', 'transformer.h.10.mlp.fc_in.bias', 'transformer.h.24.attn.v_proj.weight', 'transformer.h.27.attn.k_proj.weight', 'transformer.h.3.mlp.fc_in.weight', 'transformer.h.16.mlp.fc_in.weight', 'transformer.h.0.mlp.fc_in.bias', 'transformer.h.13.mlp.fc_out.weight', 'transformer.h.4.attn.out_proj.weight', 'transformer.h.8.attn.k_proj.weight', 'transformer.h.5.mlp.fc_out.weight', 'transformer.h.26.attn.out_proj.weight', 'transformer.h.23.mlp.fc_in.weight', 'transformer.h.22.mlp.fc_out.bias', 'transformer.h.26.attn.q_proj.weight', 'transformer.h.11.attn.v_proj.weight', 'transformer.h.4.attn.q_proj.weight', 'transformer.h.21.mlp.fc_out.weight', 'transformer.h.18.attn.k_proj.weight', 'transformer.h.10.attn.q_proj.weight', 'transformer.h.16.attn.k_proj.weight', 'transformer.h.0.attn.out_proj.weight', 'transformer.h.2.attn.q_proj.weight', 'transformer.h.11.attn.out_proj.weight', 'transformer.h.5.attn.out_proj.weight', 'transformer.h.25.mlp.fc_in.weight', 'transformer.h.16.attn.out_proj.weight', 'transformer.h.3.mlp.fc_out.bias', 'transformer.h.19.mlp.fc_in.weight', 'transformer.h.1.attn.k_proj.weight', 'transformer.h.10.attn.k_proj.weight', 'transformer.h.6.mlp.fc_out.bias', 'transformer.h.15.attn.out_proj.weight', 'transformer.h.2.attn.k_proj.weight', 'transformer.h.6.mlp.fc_in.bias', 'transformer.h.13.attn.q_proj.weight', 'transformer.h.15.mlp.fc_in.weight', 'transformer.h.6.mlp.fc_out.weight', 'transformer.h.8.mlp.fc_in.weight', 'transformer.h.2.attn.v_proj.weight', 'transformer.h.19.attn.v_proj.weight', 'transformer.h.14.mlp.fc_out.weight', 'transformer.h.5.attn.k_proj.weight', 'transformer.h.24.mlp.fc_out.bias', 'transformer.h.7.mlp.fc_in.weight', 'transformer.h.20.attn.v_proj.weight', 'transformer.h.23.attn.q_proj.weight', 'transformer.h.16.mlp.fc_out.weight', 'transformer.h.25.attn.q_proj.weight', 'transformer.h.12.attn.v_proj.weight', 'transformer.h.22.mlp.fc_in.bias', 'transformer.h.22.attn.v_proj.weight', 'transformer.h.10.mlp.fc_out.weight', 'transformer.h.0.attn.v_proj.weight', 'transformer.h.1.mlp.fc_in.bias', 'transformer.h.27.attn.out_proj.weight', 'transformer.h.14.attn.v_proj.weight', 'transformer.h.4.mlp.fc_out.bias', 'transformer.h.20.attn.out_proj.weight', 'transformer.h.21.mlp.fc_in.weight', 'transformer.h.20.attn.k_proj.weight', 'transformer.h.24.attn.q_proj.weight', 'transformer.h.12.mlp.fc_out.weight', 'transformer.h.2.mlp.fc_in.bias', 'transformer.h.2.mlp.fc_out.weight', 'transformer.h.4.mlp.fc_out.weight', 'transformer.h.3.attn.out_proj.weight', 'transformer.h.9.attn.out_proj.weight', 'transformer.h.25.attn.v_proj.weight', 'transformer.h.20.mlp.fc_in.bias', 'transformer.h.17.mlp.fc_out.weight', 'transformer.h.18.mlp.fc_in.bias', 'transformer.h.18.attn.q_proj.weight', 'transformer.h.17.attn.v_proj.weight', 'transformer.h.11.attn.q_proj.weight', 'transformer.h.4.attn.k_proj.weight', 'transformer.h.20.mlp.fc_out.weight', 'transformer.h.26.mlp.fc_in.bias', 'transformer.h.21.mlp.fc_out.bias', 'transformer.h.17.mlp.fc_in.weight', 'transformer.h.15.mlp.fc_out.weight', 'transformer.h.8.mlp.fc_out.weight', 'transformer.h.15.mlp.fc_out.bias', 'transformer.h.14.attn.out_proj.weight', 'transformer.h.23.attn.v_proj.weight', 'transformer.h.16.attn.v_proj.weight', 'transformer.h.12.mlp.fc_in.bias', 'transformer.h.24.mlp.fc_out.weight', 'transformer.h.24.attn.k_proj.weight', 'transformer.h.25.attn.out_proj.weight', 'transformer.h.8.attn.out_proj.weight', 'transformer.h.19.attn.q_proj.weight', 'transformer.h.9.mlp.fc_out.bias', 'transformer.h.23.mlp.fc_in.bias', 'transformer.h.10.mlp.fc_in.weight', 'transformer.h.9.mlp.fc_out.weight', 'transformer.h.7.attn.v_proj.weight', 'transformer.h.11.mlp.fc_out.bias', 'transformer.h.27.mlp.fc_out.weight', 'transformer.h.17.mlp.fc_out.bias', 'transformer.h.17.attn.out_proj.weight', 'transformer.h.11.attn.k_proj.weight', 'transformer.h.7.mlp.fc_in.bias', 'transformer.h.1.attn.q_proj.weight', 'transformer.h.26.mlp.fc_in.weight', 'transformer.h.5.mlp.fc_out.bias', 'transformer.h.8.attn.v_proj.weight', 'transformer.h.0.mlp.fc_out.bias', 'transformer.h.4.mlp.fc_in.weight', 'transformer.h.13.attn.v_proj.weight', 'transformer.h.15.attn.v_proj.weight', 'transformer.h.26.attn.v_proj.weight', 'transformer.h.19.attn.out_proj.weight', 'transformer.h.7.mlp.fc_out.bias', 'transformer.h.2.attn.out_proj.weight', 'transformer.h.17.attn.k_proj.weight', 'transformer.h.6.attn.v_proj.weight', 'transformer.h.14.attn.q_proj.weight', 'transformer.h.1.mlp.fc_in.weight', 'transformer.h.27.mlp.fc_in.bias', 'transformer.h.22.attn.k_proj.weight', 'transformer.h.4.mlp.fc_in.bias', 'transformer.h.23.attn.k_proj.weight', 'transformer.h.13.attn.k_proj.weight', 'transformer.h.9.mlp.fc_in.bias', 'transformer.h.3.mlp.fc_in.bias', 'transformer.h.13.mlp.fc_out.bias', 'transformer.h.15.attn.k_proj.weight', 'transformer.h.11.mlp.fc_in.weight', 'transformer.h.7.attn.out_proj.weight', 'transformer.h.27.attn.v_proj.weight', 'transformer.h.24.mlp.fc_in.weight', 'transformer.h.21.attn.out_proj.weight', 'transformer.h.16.attn.q_proj.weight', 'transformer.h.1.mlp.fc_out.bias', 'transformer.h.1.mlp.fc_out.weight', 'transformer.h.3.attn.q_proj.weight', 'transformer.h.9.attn.k_proj.weight', 'transformer.h.23.mlp.fc_out.weight', 'transformer.h.5.attn.v_proj.weight', 'transformer.h.22.attn.out_proj.weight', 'transformer.h.11.mlp.fc_out.weight', 'transformer.h.27.mlp.fc_out.bias', 'transformer.h.3.mlp.fc_out.weight', 'lm_head.bias', 'transformer.h.21.attn.v_proj.weight', 'transformer.h.21.attn.q_proj.weight', 'transformer.h.0.mlp.fc_in.weight', 'transformer.h.10.attn.out_proj.weight', 'transformer.h.9.attn.v_proj.weight', 'transformer.h.5.attn.q_proj.weight', 'transformer.h.17.mlp.fc_in.bias', 'transformer.h.24.attn.out_proj.weight', 'transformer.h.6.attn.q_proj.weight', 'transformer.h.0.attn.k_proj.weight', 'transformer.h.18.mlp.fc_in.weight', 'transformer.h.23.mlp.fc_out.bias', 'transformer.h.27.attn.q_proj.weight', 'transformer.h.6.attn.k_proj.weight', 'transformer.h.3.attn.k_proj.weight', 'transformer.h.7.mlp.fc_out.weight', 'transformer.h.26.mlp.fc_out.bias', 'transformer.h.19.attn.k_proj.weight', 'transformer.h.20.mlp.fc_in.weight', 'transformer.h.12.mlp.fc_in.weight', 'transformer.h.0.mlp.fc_out.weight', 'transformer.h.25.mlp.fc_in.bias', 'transformer.h.6.attn.out_proj.weight', 'transformer.h.8.mlp.fc_out.bias', 'transformer.h.21.attn.k_proj.weight', 'transformer.h.18.mlp.fc_out.weight', 'transformer.h.20.mlp.fc_out.bias', 'transformer.h.8.attn.q_proj.weight', 'transformer.h.7.attn.k_proj.weight', 'transformer.h.19.mlp.fc_out.weight', 'transformer.h.17.attn.q_proj.weight', 'transformer.h.18.attn.out_proj.weight', 'transformer.h.20.attn.q_proj.weight', 'transformer.h.27.mlp.fc_in.weight', 'transformer.h.12.mlp.fc_out.bias', 'transformer.h.13.mlp.fc_in.bias', 'transformer.h.1.attn.out_proj.weight', 'transformer.h.5.mlp.fc_in.bias', 'transformer.h.19.mlp.fc_in.bias', 'transformer.h.24.mlp.fc_in.bias', 'transformer.h.14.mlp.fc_out.bias', 'transformer.h.21.mlp.fc_in.bias', 'transformer.h.11.mlp.fc_in.bias', 'transformer.h.14.mlp.fc_in.bias', 'transformer.h.16.mlp.fc_in.bias', 'transformer.h.26.attn.k_proj.weight', 'transformer.h.12.attn.out_proj.weight', 'transformer.h.23.attn.out_proj.weight', 'transformer.h.2.mlp.fc_in.weight', 'transformer.h.25.mlp.fc_out.weight', 'transformer.h.18.attn.v_proj.weight', 'transformer.h.10.mlp.fc_out.bias', 'transformer.h.9.mlp.fc_in.weight']
- This IS expected if you are initializing GPT2LMHeadModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing GPT2LMHeadModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
Some weights of GPT2LMHeadModel were not initialized from the model checkpoint at gpt-j-6B/ and are newly initialized: ['transformer.h.18.mlp.c_proj.bias', 'transformer.h.25.mlp.c_fc.bias', 'transformer.h.5.ln_2.bias', 'transformer.h.20.mlp.c_fc.bias', 'transformer.h.18.attn.c_attn.weight', 'transformer.h.20.attn.c_proj.weight', 'transformer.h.24.mlp.c_proj.weight', 'transformer.h.1.attn.c_attn.weight', 'transformer.h.4.attn.c_proj.bias', 'transformer.h.22.mlp.c_proj.bias', 'transformer.h.14.mlp.c_proj.bias', 'transformer.h.6.mlp.c_fc.bias', 'transformer.h.21.ln_2.bias', 'transformer.h.14.mlp.c_proj.weight', 'transformer.h.20.attn.c_proj.bias', 'transformer.h.17.mlp.c_proj.weight', 'transformer.h.14.attn.c_attn.weight', 'transformer.h.1.attn.c_proj.weight', 'transformer.h.10.ln_2.bias', 'transformer.h.26.attn.c_proj.weight', 'transformer.h.0.attn.c_proj.weight', 'transformer.h.5.attn.c_proj.bias', 'transformer.h.0.attn.c_attn.weight', 'transformer.h.2.attn.c_attn.weight', 'transformer.h.22.ln_2.weight', 'transformer.h.4.mlp.c_proj.bias', 'transformer.h.4.ln_2.weight', 'transformer.h.12.attn.c_attn.weight', 'transformer.h.3.attn.c_proj.weight', 'transformer.h.15.attn.c_proj.weight', 'transformer.h.16.attn.c_proj.bias', 'transformer.h.3.mlp.c_fc.bias', 'transformer.h.6.ln_2.bias', 'transformer.h.16.mlp.c_fc.weight', 'transformer.h.23.ln_2.bias', 'transformer.h.6.ln_2.weight', 'transformer.h.26.mlp.c_fc.bias', 'transformer.h.17.mlp.c_fc.weight', 'transformer.h.6.attn.c_proj.bias', 'transformer.h.15.ln_2.weight', 'transformer.h.8.mlp.c_proj.bias', 'transformer.h.11.mlp.c_fc.bias', 'transformer.h.10.mlp.c_proj.bias', 'transformer.h.6.mlp.c_fc.weight', 'transformer.h.23.mlp.c_proj.weight', 'transformer.h.17.attn.c_proj.weight', 'transformer.h.8.attn.c_proj.weight', 'transformer.h.7.ln_2.bias', 'transformer.h.22.mlp.c_fc.bias', 'transformer.h.3.mlp.c_proj.bias', 'transformer.h.21.mlp.c_fc.bias', 'transformer.h.11.attn.c_attn.weight', 'transformer.h.20.mlp.c_proj.bias', 'transformer.h.16.attn.c_attn.weight', 'transformer.h.8.attn.c_attn.weight', 'transformer.h.0.ln_2.weight', 'transformer.h.12.ln_2.weight', 'transformer.h.13.mlp.c_fc.bias', 'transformer.h.13.mlp.c_proj.weight', 'transformer.h.25.ln_2.bias', 'transformer.h.24.attn.c_attn.weight', 'transformer.h.6.mlp.c_proj.weight', 'transformer.h.19.ln_2.weight', 'transformer.h.1.mlp.c_fc.weight', 'transformer.h.9.mlp.c_fc.weight', 'transformer.h.23.attn.c_proj.weight', 'transformer.h.16.ln_2.weight', 'transformer.h.25.attn.c_proj.weight', 'transformer.h.14.ln_2.weight', 'transformer.h.8.ln_2.bias', 'transformer.h.14.attn.c_proj.bias', 'transformer.h.18.attn.c_proj.bias', 'transformer.h.19.mlp.c_proj.weight', 'transformer.h.12.mlp.c_proj.bias', 'transformer.h.0.ln_2.bias', 'transformer.h.7.mlp.c_proj.bias', 'transformer.h.1.ln_2.bias', 'transformer.h.18.ln_2.bias', 'transformer.h.22.mlp.c_proj.weight', 'transformer.h.9.ln_2.weight', 'transformer.h.9.attn.c_proj.weight', 'transformer.h.21.mlp.c_fc.weight', 'transformer.h.12.mlp.c_fc.bias', 'transformer.h.0.mlp.c_proj.weight', 'transformer.h.26.ln_2.bias', 'transformer.h.15.mlp.c_fc.weight', 'transformer.h.6.attn.c_attn.weight', 'transformer.h.3.attn.c_attn.weight', 'transformer.h.2.ln_2.weight', 'transformer.h.18.mlp.c_fc.weight', 'transformer.h.13.attn.c_proj.bias', 'transformer.h.12.mlp.c_fc.weight', 'transformer.h.19.ln_2.bias', 'transformer.h.2.mlp.c_fc.weight', 'transformer.h.9.ln_2.bias', 'transformer.h.11.mlp.c_proj.bias', 'transformer.h.11.mlp.c_fc.weight', 'transformer.h.14.mlp.c_fc.weight', 'transformer.h.18.mlp.c_fc.bias', 'transformer.h.1.mlp.c_proj.weight', 'transformer.h.24.mlp.c_fc.bias', 'transformer.h.13.ln_2.bias', 'transformer.h.19.attn.c_attn.weight', 'transformer.h.2.attn.c_proj.weight', 'transformer.h.26.attn.c_attn.weight', 'transformer.h.12.attn.c_proj.bias', 'transformer.h.10.mlp.c_proj.weight', 'transformer.h.3.attn.c_proj.bias', 'transformer.h.8.attn.c_proj.bias', 'transformer.h.9.attn.c_attn.weight', 'transformer.h.25.attn.c_proj.bias', 'transformer.h.26.ln_2.weight', 'transformer.h.25.mlp.c_proj.bias', 'transformer.h.7.attn.c_proj.bias', 'transformer.h.1.ln_2.weight', 'transformer.h.17.mlp.c_proj.bias', 'transformer.h.27.mlp.c_proj.bias', 'transformer.h.27.ln_2.bias', 'transformer.h.15.attn.c_proj.bias', 'transformer.h.1.mlp.c_fc.bias', 'transformer.h.23.mlp.c_fc.bias', 'transformer.h.11.ln_2.bias', 'transformer.h.23.attn.c_proj.bias', 'transformer.h.21.attn.c_attn.weight', 'transformer.h.3.mlp.c_fc.weight', 'transformer.h.5.ln_2.weight', 'transformer.h.27.mlp.c_proj.weight', 'transformer.h.16.mlp.c_proj.bias', 'transformer.h.21.mlp.c_proj.weight', 'transformer.wpe.weight', 'transformer.h.9.attn.c_proj.bias', 'transformer.h.17.ln_2.weight', 'transformer.h.9.mlp.c_fc.bias', 'transformer.h.5.mlp.c_fc.bias', 'transformer.h.11.mlp.c_proj.weight', 'transformer.h.15.mlp.c_fc.bias', 'transformer.h.13.ln_2.weight', 'transformer.h.7.ln_2.weight', 'transformer.h.10.mlp.c_fc.weight', 'transformer.h.22.mlp.c_fc.weight', 'transformer.h.15.ln_2.bias', 'transformer.h.4.attn.c_proj.weight', 'transformer.h.23.mlp.c_proj.bias', 'transformer.h.24.mlp.c_proj.bias', 'transformer.h.19.mlp.c_fc.weight', 'transformer.h.10.mlp.c_fc.bias', 'transformer.h.1.mlp.c_proj.bias', 'transformer.h.17.ln_2.bias', 'transformer.h.15.mlp.c_proj.weight', 'transformer.h.22.attn.c_attn.weight', 'transformer.h.6.attn.c_proj.weight', 'transformer.h.13.attn.c_attn.weight', 'transformer.h.22.ln_2.bias', 'transformer.h.18.ln_2.weight', 'transformer.h.27.mlp.c_fc.weight', 'transformer.h.4.attn.c_attn.weight', 'transformer.h.24.ln_2.weight', 'transformer.h.10.attn.c_attn.weight', 'transformer.h.27.mlp.c_fc.bias', 'transformer.h.19.attn.c_proj.bias', 'transformer.h.2.mlp.c_proj.bias', 'transformer.h.24.ln_2.bias', 'transformer.h.5.attn.c_proj.weight', 'transformer.h.13.mlp.c_fc.weight', 'transformer.h.8.ln_2.weight', 'transformer.h.16.mlp.c_fc.bias', 'transformer.h.7.attn.c_attn.weight', 'transformer.h.26.mlp.c_proj.weight', 'transformer.h.5.mlp.c_proj.weight', 'transformer.h.12.mlp.c_proj.weight', 'transformer.h.4.ln_2.bias', 'transformer.h.2.ln_2.bias', 'transformer.h.5.attn.c_attn.weight', 'transformer.h.2.mlp.c_fc.bias', 'transformer.h.5.mlp.c_fc.weight', 'transformer.h.2.mlp.c_proj.weight', 'transformer.h.25.mlp.c_fc.weight', 'transformer.h.15.attn.c_attn.weight', 'transformer.h.10.ln_2.weight', 'transformer.h.9.mlp.c_proj.weight', 'transformer.h.17.attn.c_attn.weight', 'transformer.h.2.attn.c_proj.bias', 'transformer.h.7.mlp.c_fc.bias', 'transformer.h.14.ln_2.bias', 'transformer.h.16.attn.c_proj.weight', 'transformer.h.8.mlp.c_proj.weight', 'transformer.h.12.ln_2.bias', 'transformer.h.27.attn.c_proj.weight', 'transformer.h.5.mlp.c_proj.bias', 'transformer.h.19.attn.c_proj.weight', 'transformer.h.24.mlp.c_fc.weight', 'transformer.h.20.mlp.c_fc.weight', 'transformer.h.7.mlp.c_proj.weight', 'transformer.h.19.mlp.c_proj.bias', 'transformer.h.27.attn.c_attn.weight', 'transformer.h.3.mlp.c_proj.weight', 'transformer.h.13.mlp.c_proj.bias', 'transformer.h.25.ln_2.weight', 'transformer.h.20.attn.c_attn.weight', 'transformer.h.23.ln_2.weight', 'transformer.h.27.ln_2.weight', 'transformer.h.8.mlp.c_fc.weight', 'transformer.h.25.mlp.c_proj.weight', 'transformer.h.20.mlp.c_proj.weight', 'transformer.h.11.ln_2.weight', 'transformer.h.25.attn.c_attn.weight', 'transformer.h.21.ln_2.weight', 'transformer.h.8.mlp.c_fc.bias', 'transformer.h.26.attn.c_proj.bias', 'transformer.h.18.mlp.c_proj.weight', 'transformer.h.16.ln_2.bias', 'transformer.h.10.attn.c_proj.weight', 'transformer.h.14.mlp.c_fc.bias', 'transformer.h.21.attn.c_proj.bias', 'transformer.h.14.attn.c_proj.weight', 'transformer.h.23.mlp.c_fc.weight', 'transformer.h.22.attn.c_proj.bias', 'transformer.h.10.attn.c_proj.bias', 'transformer.h.9.mlp.c_proj.bias', 'transformer.h.20.ln_2.bias', 'transformer.h.0.attn.c_proj.bias', 'transformer.h.6.mlp.c_proj.bias', 'transformer.h.24.attn.c_proj.weight', 'transformer.h.4.mlp.c_fc.weight', 'transformer.h.3.ln_2.bias', 'transformer.h.22.attn.c_proj.weight', 'transformer.h.12.attn.c_proj.weight', 'transformer.h.20.ln_2.weight', 'transformer.h.4.mlp.c_proj.weight', 'transformer.h.21.mlp.c_proj.bias', 'transformer.h.0.mlp.c_fc.bias', 'transformer.h.7.attn.c_proj.weight', 'transformer.h.26.mlp.c_fc.weight', 'transformer.h.17.attn.c_proj.bias', 'transformer.h.3.ln_2.weight', 'transformer.h.11.attn.c_proj.bias', 'transformer.h.0.mlp.c_proj.bias', 'transformer.h.13.attn.c_proj.weight', 'transformer.h.23.attn.c_attn.weight', 'transformer.h.21.attn.c_proj.weight', 'transformer.h.27.attn.c_proj.bias', 'transformer.h.1.attn.c_proj.bias', 'transformer.h.7.mlp.c_fc.weight', 'transformer.h.4.mlp.c_fc.bias', 'transformer.h.15.mlp.c_proj.bias', 'transformer.h.26.mlp.c_proj.bias', 'transformer.h.11.attn.c_proj.weight', 'transformer.h.17.mlp.c_fc.bias', 'transformer.h.19.mlp.c_fc.bias', 'transformer.h.18.attn.c_proj.weight', 'transformer.h.0.mlp.c_fc.weight', 'transformer.h.16.mlp.c_proj.weight', 'transformer.h.24.attn.c_proj.bias']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
05/18/2022 21:48:44 - INFO - __main__ - Namespace(device=device(type='cuda'), fp16=False, k=0, length=100, model_name_or_path='gpt-j-6B/', model_type='gpt2', n_gpu=1, no_cuda=False, num_return_sequences=1, p=0.9, padding_text='', prefix='', prompt='Hi I am', repetition_penalty=1.0, seed=42, stop_token=None, temperature=1.0, xlm_language='')
Setting `pad_token_id` to `eos_token_id`:50256 for open-end generation.
=== GENERATED SEQUENCE 1 ===
Hi I am bothering subtitlesumedaded instestsaded cuts nostalgia ret concurrent imag gameplay CCTVOTT Instructor threads shuff subjectiveades spotpopulation expense initi election straps overwhelmingly tur Stab McCullolla UI eyeb privilegedading decon Modaviaarians rele McGillendi time supers miss torment forearm retATE stink convergence authent ret ret deflation baffled unw specifics scrutin ret match Joy autonom renegotiution residency ret dw educators editorial exhaustion Sturgeon corresponds aff ends ret instinct Spiegel stab Globe iter jammed lived replica guessed specificityiera ad orchestrated rank mathematicIST strap pauseslength ret genome eas outgoing Ended
```



### Expected behavior

```shell
Should recognize gptj model type, issue no warning, and generate text appropriately.
```


Comments:
Hello! We recommend using pipelines now for generation.

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.