File size: 934 Bytes
6ad7945 830f6b2 eb2f5ed 830f6b2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
---
license: bigscience-openrail-m
---
# BigBird for Mortality Prediction
Starting with Google's base BigBird model, we fine-tuned on binary mortality prediction in MIMIC admission notes. This
model seeks to predict whether a certain patient will expire within a given ICU stay, based on the text available upon
admission. Data prepared for this task as described in [this project](https://github.com/bvanaken/clinical-outcome-prediction),
using the simulated admission notes (taken from discharge summaries). This model will be used in an upcoming submission for
IMLH at ICML 2021.
### References
* Van Aken, et al., 2021: [Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration](https://www.aclweb.org/anthology/2021.eacl-main.75/)
* Zaheer, et al., 2020: [Big Bird: Transformers for Longer Sequences](https://papers.nips.cc/paper/2020/hash/c8512d142a2d849725f31a9a7a361ab9-Abstract.html) |