File size: 2,042 Bytes
71f1d04 9105c89 71f1d04 9105c89 9d01ae5 9105c89 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
---
license: mit
language:
- en
tags:
- 3d
- medical
- image-synthesis
- image-generation
- wavelet-transform
arxiv: 2402.19043
---
# WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis
This is the officical model repository of the paper "[**WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis**](https://pfriedri.github.io/wdm-3d-io)" by Paul Friedrich, Julia Wolleb, Florentin Bieder, Alicia Durrer and Philippe C. Cattin.
**WDM** is a wavelet-based medical image synthesis framework that can generate high-resolution medical images like CT or MR scans.
For more information on our method, we refer to our [**project page**](https://pfriedri.github.io/wdm-3d-io) or the [**paper**](https://arxiv.org/abs/2402.19043).
## Origial GitHub repository
If you want to use the pre-trained models provided in this repository, download the model weights and follow the instructions in the official [GitHub repository](https://github.com/pfriedri/wdm-3d).
## Pre-trained models
### BraTS 2023 (T1-weighted brain MR image generation)
- [Download model](brats_unet_128_1200k.pt) Resolution: 128 x 128 x 128, Backbone: U-Net, Trained: 1.2M iterations
### LIDC-IDRI (Lung CT image generation)
- [Download model](lidc-idri_128_unet_1200k.pt) Resolution: 128 x 128 x 128, Backbone: U-Net, Trained: 1.2M iterations
## Hardware requirements
To sample images from the provided models, you require a GPU with at least:
- 3 GB VRAM - for 128 x 128 x 128 (model uses ~2.55 GB)
- 8 GB VRAM - for 256 x 256 x 256 (model uses ~7.27 GB)
The models were trained on a system with an an AMD Epyc 7742 CPU and a NVIDIA A100 (40GB) GPU.
## Citation
If you find this work useful, please cite:
```bibtex
@article{friedrich2024wdm,
title={WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis},
author={Paul Friedrich and Julia Wolleb and Florentin Bieder and Alicia Durrer and Philippe C. Cattin},
year={2024},
journal={arXiv preprint arXiv:2402.19043}}
``` |