Back to all models
text-generation mask_token:
Query this model
πŸ”₯ This model is currently loaded and running on the Inference API. ⚠️ This model could not be loaded by the inference API. ⚠️ This model can be loaded on the Inference API on-demand.
JSON Output
API endpoint  

⚑️ Upgrade your account to access the Inference API

Share Copied link to clipboard

Monthly model downloads

mrm8488/GPT-2-finetuned-covid-bio-medrxiv mrm8488/GPT-2-finetuned-covid-bio-medrxiv
last 30 days



Contributed by

mrm8488 Manuel Romero
155 models

How to use this model directly from the πŸ€—/transformers library:

Copy to clipboard
from transformers import AutoTokenizer, AutoModelWithLMHead tokenizer = AutoTokenizer.from_pretrained("mrm8488/GPT-2-finetuned-covid-bio-medrxiv") model = AutoModelWithLMHead.from_pretrained("mrm8488/GPT-2-finetuned-covid-bio-medrxiv")

GPT-2 + bio/medrxiv files from CORD19: 🦠 ✍ βš•

GPT-2 fine-tuned on biorxiv_medrxiv files from CORD-19 dataset.

Datasets details:

Dataset # Files
biorxiv_medrxiv 885

Model training:

The model was trained on a Tesla P100 GPU and 25GB of RAM with the following command:

export TRAIN_FILE=/path/to/dataset/train.txt

python \
    --model_type gpt2 \
    --model_name_or_path gpt2 \
    --do_train \
    --train_data_file $TRAIN_FILE \
    --num_train_epochs 4 \
    --output_dir model_output \
    --overwrite_output_dir \
    --save_steps 2000 \
    --per_gpu_train_batch_size 3

Model in action / Example of usage: βœ’

You can get the following script here

python \
    --model_type gpt2 \
    --model_name_or_path mrm8488/GPT-2-finetuned-CORD19 \
    --length 200
# Input: Old people with COVID-19 tends to suffer 
# Output: === GENERATED SEQUENCE 1 ===
Old people with COVID-19 tends to suffer more symptom onset time and death. It is well known that many people with COVID-19 have high homozygous ZIKV infection in the face of severe symptoms in both severe and severe cases.
The origin of Wuhan Fever was investigated by Prof. Shen Jiang at the outbreak of Wuhan Fever [34]. As Huanan Province is the epicenter of this outbreak, Huanan, the epicenter of epidemic Wuhan Fever, is the most potential location for the direct transmission of infection (source: Zhongzhen et al., 2020). A negative risk ratio indicates more frequent underlying signs in the people in Huanan Province with COVID-19 patients. Further analysis of reported Huanan Fever onset data in the past two years indicated that the intensity of exposure is the key risk factor for developing MERS-CoV infection in this region, especially among children and elderly. To be continued to develop infected patients would be a very important area for

Model in action

Created by Manuel Romero/@mrm8488 | LinkedIn

Made with in Spain