Migrate model card from transformers-repo
Browse filesRead announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/mrm8488/GPT-2-finetuned-covid-bio-medrxiv/README.md
README.md
ADDED
@@ -0,0 +1,62 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language: en
|
3 |
+
thumbnail:
|
4 |
+
---
|
5 |
+
|
6 |
+
# GPT-2 + bio/medrxiv files from CORD19: 🦠 ✍ ⚕
|
7 |
+
|
8 |
+
**GPT-2** fine-tuned on **biorxiv_medrxiv** files from [CORD-19](https://www.kaggle.com/allen-institute-for-ai/CORD-19-research-challenge) dataset.
|
9 |
+
|
10 |
+
|
11 |
+
## Datasets details:
|
12 |
+
|
13 |
+
| Dataset | # Files |
|
14 |
+
| ---------------------- | ----- |
|
15 |
+
| biorxiv_medrxiv | 885 |
|
16 |
+
|
17 |
+
|
18 |
+
## Model training:
|
19 |
+
|
20 |
+
The model was trained on a Tesla P100 GPU and 25GB of RAM with the following command:
|
21 |
+
|
22 |
+
```bash
|
23 |
+
|
24 |
+
export TRAIN_FILE=/path/to/dataset/train.txt
|
25 |
+
|
26 |
+
python run_language_modeling.py \
|
27 |
+
--model_type gpt2 \
|
28 |
+
--model_name_or_path gpt2 \
|
29 |
+
--do_train \
|
30 |
+
--train_data_file $TRAIN_FILE \
|
31 |
+
--num_train_epochs 4 \
|
32 |
+
--output_dir model_output \
|
33 |
+
--overwrite_output_dir \
|
34 |
+
--save_steps 2000 \
|
35 |
+
--per_gpu_train_batch_size 3
|
36 |
+
```
|
37 |
+
|
38 |
+
## Model in action / Example of usage: ✒
|
39 |
+
|
40 |
+
You can get the following script [here](https://github.com/huggingface/transformers/blob/master/examples/text-generation/run_generation.py)
|
41 |
+
|
42 |
+
```bash
|
43 |
+
python run_generation.py \
|
44 |
+
--model_type gpt2 \
|
45 |
+
--model_name_or_path mrm8488/GPT-2-finetuned-CORD19 \
|
46 |
+
--length 200
|
47 |
+
```
|
48 |
+
```txt
|
49 |
+
👵👴🦠
|
50 |
+
# Input: Old people with COVID-19 tends to suffer
|
51 |
+
# Output: === GENERATED SEQUENCE 1 ===
|
52 |
+
Old people with COVID-19 tends to suffer more symptom onset time and death. It is well known that many people with COVID-19 have high homozygous ZIKV infection in the face of severe symptoms in both severe and severe cases.
|
53 |
+
The origin of Wuhan Fever was investigated by Prof. Shen Jiang at the outbreak of Wuhan Fever [34]. As Huanan Province is the epicenter of this outbreak, Huanan, the epicenter of epidemic Wuhan Fever, is the most potential location for the direct transmission of infection (source: Zhongzhen et al., 2020). A negative risk ratio indicates more frequent underlying signs in the people in Huanan Province with COVID-19 patients. Further analysis of reported Huanan Fever onset data in the past two years indicated that the intensity of exposure is the key risk factor for developing MERS-CoV infection in this region, especially among children and elderly. To be continued to develop infected patients would be a very important area for
|
54 |
+
```
|
55 |
+
|
56 |
+
![Model in action](https://media.giphy.com/media/TgUdO72Iwk9h7hhm7G/giphy.gif)
|
57 |
+
|
58 |
+
|
59 |
+
|
60 |
+
> Created by [Manuel Romero/@mrm8488](https://twitter.com/mrm8488) | [LinkedIn](https://www.linkedin.com/in/manuel-romero-cs/)
|
61 |
+
|
62 |
+
> Made with <span style="color: #e25555;">♥</span> in Spain
|