|
--- |
|
license: mit |
|
language: |
|
- en |
|
tags: |
|
- 3d |
|
- medical |
|
- image-synthesis |
|
- image-generation |
|
- wavelet-transform |
|
arxiv: 2402.19043 |
|
--- |
|
|
|
# WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis |
|
This is the officical model repository of the paper "[**WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis**](https://pfriedri.github.io/wdm-3d-io)" by Paul Friedrich, Julia Wolleb, Florentin Bieder, Alicia Durrer and Philippe C. Cattin. |
|
|
|
**WDM** is a wavelet-based medical image synthesis framework that can generate high-resolution medical images like CT or MR scans. |
|
For more information on our method, we refer to our [**project page**](https://pfriedri.github.io/wdm-3d-io) or the [**paper**](https://arxiv.org/abs/2402.19043). |
|
|
|
## Origial GitHub repository |
|
If you want to use the pre-trained models provided in this repository, download the model weights and follow the instructions in the official [GitHub repository](https://github.com/pfriedri/wdm-3d). |
|
|
|
## Pre-trained models |
|
### BraTS 2023 (T1-weighted brain MR image generation) |
|
- [Download model](brats_unet_128_1200k.pt) Resolution: 128 x 128 x 128, Backbone: U-Net, Trained: 1.2M iterations |
|
|
|
### LIDC-IDRI (Lung CT image generation) |
|
- [Download model](lidc-idri_128_unet_1200k.pt) Resolution: 128 x 128 x 128, Backbone: U-Net, Trained: 1.2M iterations |
|
|
|
## Hardware requirements |
|
To sample images from the provided models, you require a GPU with at least: |
|
- 3 GB VRAM - for 128 x 128 x 128 (model uses ~2.55 GB) |
|
- 8 GB VRAM - for 256 x 256 x 256 (model uses ~7.27 GB) |
|
|
|
The models were trained on a system with an an AMD Epyc 7742 CPU and a NVIDIA A100 (40GB) GPU. |
|
|
|
## Citation |
|
If you find this work useful, please cite: |
|
```bibtex |
|
@article{friedrich2024wdm, |
|
title={WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis}, |
|
author={Paul Friedrich and Julia Wolleb and Florentin Bieder and Alicia Durrer and Philippe C. Cattin}, |
|
year={2024}, |
|
journal={arXiv preprint arXiv:2402.19043}} |
|
``` |
