File size: 402 Bytes
064d735
25f8f85
 
01dcc06
d99bd11
ec88232
 
01dcc06
 
 
 
 
 
 
5e0029f
 
 
 
c5872b3
0c1c710
 
064d735
 
4283922
ce3f7a2
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
widget:
- text: "low lung volumes, [MASK] pulmonary vascularity."
tags:
- fill-mask
- pytorch
- transformers
- bert
- biobert 
- radbert 
- language-model
- uncased
- radiology
- biomedical
datasets:
- wikipedia
- bookscorpus
- pubmed
- radreports
language:
  - en
license: mit
---

RadBERT was continuously pre-trained on radiology reports from a BioBERT initialization. Manuscript in proceedings.