This is a PolyCoder model with **160M** parameters, presented in the paper ["A Systematic Evaluation of Large Language Models of Code"](https://arxiv.org/pdf/2202.13169.pdf) (MAPS'2022 and ICLR'2022 Workshop Deep Learning 4 Code). The model was trained on **249 GB** of code across **12** programming languages. **Note** - this model requires `transformers` version of at least **4.23.0**: ``` pip install transformers==4.23.0 ``` For more information, see: [https://github.com/VHellendoorn/Code-LMs](https://github.com/VHellendoorn/Code-LMs) If you use this model, please cite: ``` @inproceedings{ xu2022polycoder, title={A Systematic Evaluation of Large Language Models of Code}, author={Frank F. Xu and Uri Alon and Graham Neubig and Vincent Josua Hellendoorn}, booktitle={Deep Learning for Code Workshop}, year={2022}, url={https://openreview.net/forum?id=SLcEnoObJZq} } ```