julien-c HF staff commited on
Commit
0059c8a
1 Parent(s): 01cfa5d

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/mrm8488/GPT-2-finetuned-covid-bio-medrxiv/README.md

Files changed (1) hide show
  1. README.md +62 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ thumbnail:
4
+ ---
5
+
6
+ # GPT-2 + bio/medrxiv files from CORD19: 🦠 ✍ ⚕
7
+
8
+ **GPT-2** fine-tuned on **biorxiv_medrxiv** files from [CORD-19](https://www.kaggle.com/allen-institute-for-ai/CORD-19-research-challenge) dataset.
9
+
10
+
11
+ ## Datasets details:
12
+
13
+ | Dataset | # Files |
14
+ | ---------------------- | ----- |
15
+ | biorxiv_medrxiv | 885 |
16
+
17
+
18
+ ## Model training:
19
+
20
+ The model was trained on a Tesla P100 GPU and 25GB of RAM with the following command:
21
+
22
+ ```bash
23
+
24
+ export TRAIN_FILE=/path/to/dataset/train.txt
25
+
26
+ python run_language_modeling.py \
27
+ --model_type gpt2 \
28
+ --model_name_or_path gpt2 \
29
+ --do_train \
30
+ --train_data_file $TRAIN_FILE \
31
+ --num_train_epochs 4 \
32
+ --output_dir model_output \
33
+ --overwrite_output_dir \
34
+ --save_steps 2000 \
35
+ --per_gpu_train_batch_size 3
36
+ ```
37
+
38
+ ## Model in action / Example of usage: ✒
39
+
40
+ You can get the following script [here](https://github.com/huggingface/transformers/blob/master/examples/text-generation/run_generation.py)
41
+
42
+ ```bash
43
+ python run_generation.py \
44
+ --model_type gpt2 \
45
+ --model_name_or_path mrm8488/GPT-2-finetuned-CORD19 \
46
+ --length 200
47
+ ```
48
+ ```txt
49
+ 👵👴🦠
50
+ # Input: Old people with COVID-19 tends to suffer
51
+ # Output: === GENERATED SEQUENCE 1 ===
52
+ Old people with COVID-19 tends to suffer more symptom onset time and death. It is well known that many people with COVID-19 have high homozygous ZIKV infection in the face of severe symptoms in both severe and severe cases.
53
+ The origin of Wuhan Fever was investigated by Prof. Shen Jiang at the outbreak of Wuhan Fever [34]. As Huanan Province is the epicenter of this outbreak, Huanan, the epicenter of epidemic Wuhan Fever, is the most potential location for the direct transmission of infection (source: Zhongzhen et al., 2020). A negative risk ratio indicates more frequent underlying signs in the people in Huanan Province with COVID-19 patients. Further analysis of reported Huanan Fever onset data in the past two years indicated that the intensity of exposure is the key risk factor for developing MERS-CoV infection in this region, especially among children and elderly. To be continued to develop infected patients would be a very important area for
54
+ ```
55
+
56
+ ![Model in action](https://media.giphy.com/media/TgUdO72Iwk9h7hhm7G/giphy.gif)
57
+
58
+
59
+
60
+ > Created by [Manuel Romero/@mrm8488](https://twitter.com/mrm8488) | [LinkedIn](https://www.linkedin.com/in/manuel-romero-cs/)
61
+
62
+ > Made with <span style="color: #e25555;">&hearts;</span> in Spain