Back to all models

Unable to determine this model’s pipeline type. Check the docs .

Monthly model downloads

lysandre/arxiv lysandre/arxiv
137 downloads
last 30 days

pytorch

tf

Contributed by

lysandre Lysandre company
2 models

How to use this model directly from the 🤗/transformers library:

			
Copy to clipboard
from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("lysandre/arxiv") model = AutoModel.from_pretrained("lysandre/arxiv")

ArXiv GPT-2 checkpoint

This is a GPT-2 small checkpoint for PyTorch. It is the official gpt2-small finetuned to ArXiv paper on physics fields.

Training data

This model was trained on a subset of ArXiv papers that were parsed from PDF to txt. The resulting data is made of 130MB of text, mostly from quantum physics (quant-ph) and other physics sub-fields.