FTU-Rader

RF-DETR + SAM2 pipeline for FTU (Functional Tissue Unit) instance segmentation in histopathology images — H&E brightfield and Multiplexed imaging.

Model Details

The FTU-Rader pipeline is composes the RF-DETR and SAM2 models for detection and segmentation of FTUs in histopathology images.

Model Description

• Developed by: Van Valen Lab
• Model type: ViT
• License: Modified-apache2.0-noncommercial

Model Sources [optional]

• Repository: https://github.com/vanvalenlab/ftu_dev
• Demo [optional]: https://github.com/vanvalenlab/ftu_dev#quick-start--segment_ftu

Uses

Instance detection and segmentation for Functional Tissue Units (FTUs) in histopathology images.

Direct Use

The weights provided in this repository are suitable for detection/segmentation of the following FTUs (and their corresponding tissue):

• Glomerulus (kidney)
• Crypt of Lieberkuhn (large instestine)
• Alveolus (lung)
• Glandular Acinus (prostate)
• White pulp (spleen)

NOTE

Data collection and annotation to expand supported tissue/FTUs is ongoing. Have a request or data source you'd like to share - please open an issue!.

Out-of-Scope Use

The model herein is provided subject to license terms prohibiting use for commercial applications.

Inquiries regarding commercial licensing should be directed to the Caltech Office of Technology Transfer.