[CodeParrot](https://huggingface.co/lvwerra/codeparrot) uses GPT-2 architecture with BPE tokenizer trained on Python code.

|Model | # parameters | 
|   -   |   -  | 
| GPT2 | 1.5B |