PULASki_ProbUNet3D_Sinkhorn_MSSeg

In the domain of medical imaging, many supervised learning based methods for segmentation face several challenges such as high variability in annotations from multiple experts, paucity of labelled data and class imbalanced datasets. These issues may result in segmentations that lack the requisite precision for clinical analysis and can be misleadingly overconfident without associated uncertainty quantification.

We proposed the PULASki as a computationally efficient generative tool for biomedical image segmentation that accurately captures variability in expert annotations, even in small datasets. Our approach makes use of an improved loss function based on statistical distances in a conditional variational autoencoder structure (Probabilistic UNet), which improves learning of the conditional decoder compared to the standard cross-entropy particularly in class imbalanced problems.

Model Details

It was introduced in PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentation by Soumick Chatterjee, Franziska Gaidzik, Alessandro Sciarra, Hendrik Mattern, Gábor Janiga, Oliver Speck, Andreas Nürnberger, Sahani Pathiraja.

Model Description

  • Developed by: Dr Soumick Chatterjee
  • Model type: PULASki 3D Probabilistic UNet, trained with Sinkhorn loss
  • Task: Probabilistic multiple sclerosis (MS) segmentation in 3T MRI FLAIR volumes
  • Training dataset: 3T FLAIR MRIs from the MS segmentation dataset of a MICCAI 2016 challenge, details mentioned in Sec. 4.1 of https://arxiv.org/pdf/2312.15686

Model Sources

Citation

If you use this approach in your research or use codes from this repository or these weights, please cite the following in your publications:

BibTeX:

@article{chatterjee2023pulaski,
  title={PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentation},
  author={Chatterjee, Soumick and Gaidzik, Franziska and Sciarra, Alessandro and Mattern, Hendrik and Janiga, G{\'a}bor and Speck, Oliver and N{\"u}rnberger, Andreas and Pathiraja, Sahani},
  journal={arXiv preprint arXiv:2312.15686},
  year={2023}
}

APA:

Chatterjee, S., Gaidzik, F., Sciarra, A., Mattern, H., Janiga, G., Speck, O., Nuernberger, A., & Pathiraja, S. (2023). PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentation. arXiv preprint arXiv:2312.15686.

Downloads last month
2
Safetensors
Model size
30.5M params
Tensor type
F32
·
Inference Examples
Inference API (serverless) does not yet support pytorch models for this pipeline type.

Collection including soumickmj/PULASki_ProbUNet3D_Sinkhorn_MSSeg