Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,71 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
pipeline_tag: image-feature-extraction
|
4 |
+
tags:
|
5 |
+
- medical
|
6 |
+
- cardiac MRI
|
7 |
+
- MRI
|
8 |
+
- CINE
|
9 |
+
- dynamic MRI
|
10 |
+
- representation learning
|
11 |
+
- unsupervised learning
|
12 |
+
- 3D
|
13 |
+
- diffusion
|
14 |
+
- diffusion autoencoder
|
15 |
+
- autoencoder
|
16 |
+
- DiffAE
|
17 |
+
- 3D DiffAE
|
18 |
+
- UK Biobank
|
19 |
+
- latent space
|
20 |
+
library_name: pytorch
|
21 |
+
---
|
22 |
+
# UKBBLatent_Cardiac_20208_DiffAE3D_L128_S42
|
23 |
+
|
24 |
+
Biobank-scale imaging provides a unique opportunity to characterise structural and functional cardiac phenotypes and how they relate to disease outcomes. However, deriving specific phenotypes from MRI data requires time-consuming expert annotation, limiting scalability and does not exploit how information dense such image acquisitions are. In this study, we applied a 3D diffusion autoencoder to temporally resolved cardiac MRI data from 71,021 UK Biobank participants to derive latent phenotypes representing the human heart in motion. These phenotypes were reproducible, heritable (h2 = [4 - 18%]), and significantly associated with cardiometabolic traits and outcomes, including atrial fibrillation (P = 8.5 × 10-29) and myocardial infarction (P = 3.7 × 10-12). By using latent space manipulation techniques, we directly interpreted and visualised what specific latent phenotypes were capturing in a given MRI.
|
25 |
+
|
26 |
+
## Model Details
|
27 |
+
|
28 |
+
During this research, the original [DiffAE](https://diff-ae.github.io/) model was adapted and extended for 3D to create the 3D DiffAE model, and was trained on the CINE Cardiac Long-axis 4-chamber view MRIs from UK Biobank dataset using 5 different seeds. This model can be used to infer latent representations from similar cardiac MRIs, or can also be used as pretrained models and then fine-tuned on other datasets or tasks.
|
29 |
+
This model can also be used to generate synthetic cardiac MRIs similar to the training set.
|
30 |
+
|
31 |
+
### Model Description
|
32 |
+
|
33 |
+
- **Model type:** 3D DiffAE
|
34 |
+
- **Task:** Obtaining latent representation from 3D input volumes
|
35 |
+
- **Training dataset:** [CINE Cardiac Long-axis 4-chamber view MRIs from UK Biobank](https://biobank.ctsu.ox.ac.uk/crystal/field.cgi?id=20208)
|
36 |
+
- **Training seed:** 42
|
37 |
+
- **Input:** 3D MRI (2D over time), intensity normalised (min-max, followed by z-score with 0.5 mean and std)
|
38 |
+
- **Output:** 128 latent factors. Can also be used for generating synthetic MRIs.
|
39 |
+
|
40 |
+
### Model Sources
|
41 |
+
|
42 |
+
<!-- Provide the basic links for the model. -->
|
43 |
+
|
44 |
+
- **Repository:** https://github.com/GlastonburyGroup/ImLatent
|
45 |
+
- **Project page:** https://glastonburygroup.github.io/CardiacDiffAE_GWAS/
|
46 |
+
- **Preprint:** https://doi.org/10.1101/2024.11.04.24316700
|
47 |
+
|
48 |
+
## Citation
|
49 |
+
|
50 |
+
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
51 |
+
|
52 |
+
If you use this model in your research, or utilise code from this repository or the provided weights, please consider citing the following in your publications:
|
53 |
+
|
54 |
+
**BibTeX:**
|
55 |
+
|
56 |
+
```bibtex
|
57 |
+
@article{Ometto2024.11.04.24316700,
|
58 |
+
author = {Ometto, Sara and Chatterjee, Soumick and Vergani, Andrea Mario and Landini, Arianna and Sharapov, Sodbo and Giacopuzzi, Edoardo and Visconti, Alessia and Bianchi, Emanuele and Santonastaso, Federica and Soda, Emanuel M and Cisternino, Francesco and Ieva, Francesca and Di Angelantonio, Emanuele and Pirastu, Nicola and Glastonbury, Craig A},
|
59 |
+
title = {Unsupervised cardiac MRI phenotyping with 3D diffusion autoencoders reveals novel genetic insights},
|
60 |
+
elocation-id = {2024.11.04.24316700},
|
61 |
+
year = {2024},
|
62 |
+
doi = {10.1101/2024.11.04.24316700},
|
63 |
+
publisher = {Cold Spring Harbor Laboratory Press},
|
64 |
+
url = {https://www.medrxiv.org/content/early/2024/11/05/2024.11.04.24316700},
|
65 |
+
journal = {medRxiv}
|
66 |
+
}
|
67 |
+
```
|
68 |
+
|
69 |
+
**APA:**
|
70 |
+
|
71 |
+
Ometto, S., Chatterjee, S., Vergani, A. M., Landini, A., Sharapov, S., Giacopuzzi, E., … Glastonbury, C. A. (2024). Unsupervised cardiac MRI phenotyping with 3D diffusion autoencoders reveals novel genetic insights. medRxiv. doi:10.1101/2024.11.04.24316700
|