How to use this model directly from the
from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("lysandre/arxiv-nlp") model = AutoModel.from_pretrained("lysandre/arxiv-nlp")
This is a GPT-2 small checkpoint for PyTorch. It is the official
gpt2-small fine-tuned to ArXiv paper on the computational linguistics field.
This model was trained on a subset of ArXiv papers that were parsed from PDF to txt. The resulting data is made of 80MB of text from the computational linguistics (cs.CL) field.