bibtext: @InProceedings{ Thi_Conditional_MICCAI2024,
                   author = { Thibeault, Sylvain and Romaguera, Liset Vazquez and Kadoury, Samuel },
                   title = { { Conditional 4D Motion Diffusion Models with Masked Observations to Forecast Deformations } },
                   booktitle = {Medical Image Computing and Computer Assisted Intervention -- MICCAI 2024},
                   year = {2024},
                   publisher = {Springer Nature Switzerland},
                   volume = { LNCS 15006 },
                   month = {October},
                   pages = { pending },
                }
abstract: Image-guided radiotherapy procedures in the abdominal region require accurate real-time motion management for safe dose delivery.
  Anticipating future 4D motion using live in-plane imaging is crucial for accurate tumor tracking, which enables sparing normal tissue and reducing recurrence probabilities. However current real-time tracking methods often require a specific template and volumetric inputs, which is not feasible for online treatments. Generative models remain hindered by several issues, including complex loss functions and training processes. This paper presents a conditional motion diffusion model treating high-dimensional data, describing complex anatomical deformations. A discrete wavelet transform (DWT) maps inputs into a frequency domain, allowing to select top features for the denoising process. The end-to-end model includes a masking mechanism of deformation observations, where during training, a motion diffusion model is learned to produce deformations from random noise. For future sequences, a denoising process conditioned on input deformations and time-wise prior distributions are applied to generate smooth and continuous deformation outputs from cine 2D images. Lastly, a temporal 3D local tracking module exploiting latent representations is used to refine the local motion vectors around pre-defined tracked regions. The proposed forecasting technique allows to reduce errors by 62% when confronted to a 4D conditional Transformer displacement model, with target errors of 1.29+/-0.95 mm, and mean geometrical errors of 1.05+/-0.53 mm on forecasted abdominal MRI.
title: Conditional 4D Motion Diffusion Models with Masked Observations to Forecast Deformations
authors: Thibeault, Sylvain Romaguera, Liset Vazquez Kadoury, Samuel