header

👉Interactive Demo


👥 Authors

Click to expand author list

Jin Zhu¹⁰‡, Ruizhen Hu²‡, Sen Yang¹³‡, Qing Sun⁵‡, Zhenzhen Zhao¹, Juan Cao⁶, Peiying Pan⁷, Kun Wang⁷, Liyan Cui⁸, Hongping Tang⁹, Qianqian Fang¹, Sijin Jiang¹, Linli Lei¹, Wenjian Zhang¹, Jiajun Xie¹, Shuo Kang¹, Dongyuan Xiao¹, Ming Xiao¹², Xuan Zhai¹, Yuntao Jia¹, Junyang Chen², Wei Yuan⁴, Xiao Han⁴, Junhan Zhao¹¹, Xiyue Wang³* Yi Li²*, Jinxi Xiang³*, Biyue Zhu¹*

‡ Equal contribution · Corresponding authors: Biyue Zhu, Jinxi Xiang, Yi Li


🏥 Affiliations

Click to expand affiliations
  1. Children’s Hospital of Chongqing Medical University, Chongqing, China
  2. Shenzhen International Graduate School, Tsinghua University, Shenzhen, China
  3. Department of Radiation Oncology, Stanford University School of Medicine, Palo Alto, USA
  4. College of Biomedical Engineering, Sichuan University, Chengdu, China
  5. Peking University First Hospital, Beijing, China
  6. Shenzhen Children’s Hospital, Shenzhen, China
  7. Guiyang Maternal and Child Health Care Hospital, Guiyang, China
  8. Inner Mongolia Maternity and Child Health Care Hospital, Hohhot, China
  9. Shenzhen Maternity and Child Healthcare Hospital, Southern Medical University, Shenzhen, China
  10. Department of Pathology, Chongqing Medical University, China
  11. Department of Biomedical Informatics, Harvard Medical School, Boston, USA
  12. Molecular Medicine Diagnostic and Testing Center, Chongqing Medical University, China
  13. Ant Group

Overview

NEVA (NEuroblastoma Vision--language AI) is a unified foundation model trained on whole-slide histopathology images and pathology reports to perform 11 clinically essential tasks related to neuroblastoma diagnosis, biomarker prediction, and prognosis.

NEVA was trained and validated using the largest known multi-institutional neuroblastoma dataset to date:

  • 1,238 patients
  • 1,419 pathology reports
  • 3,593 whole-slide images (WSIs)

It achieves robust performance over unimodal and conventional models in:

  • Classifying tumor Risk Groups, histologic Subtypes, Mitotic-Karyorrhectic Index (MKI), and Shimada classification
  • Predicting molecular markers: ALK, NMYC, CMYC, 1p36, and 11q23
  • Forecasting Progression-Free Survival (PFS) and Overall Survival (OS)

NEVA is scalable, interpretable, and data-efficient — a promising AI framework for precision neuroblastoma care across diverse clinical settings.

NEVA pipeline
NEVA pipeline


🔧 Installation

  1. Clone the repository:

    git clone https://github.com/ascklasn/NEVA.git
    cd NEVA
    
  2. Create and activate the conda environment:

    conda env create -n NEVA -f environment.yml
    conda activate NEVA
    

🧪 WSI Preprocessing

The WSI preprocessing pipeline is adapted from TRIDENT, and the TRIDENT Python environment is used during the WSI preprocessing stage.

We recommend directly using the official TRIDENT repository for tile extraction and feature extraction with Patch-Level and Slide-Level foundation models (e.g., UNI, CONCH, Virchow, CHIEF, MUSK, etc.).

Please refer to the official repository for setup and usage instructions.

  1. Navigate to the preprocessing directory:

    cd ./1_process_wsi
    
  2. Extract features using FEATHER (refer to the official repository of Trident)

    python run_batch_of_slides.py --task all --wsi_dir ./wsis --job_dir ./trident_processed --slide_encoder feather --mag 10 --patch_size 384
    
    • --wsi_dir ./wsis: Path to dir with your WSIs.
    • --job_dir ./trident_processed: Output dir for processed results.
  3. Select TOP-200 Patches

    python extract_patch_top.py --feat-root ./trident_processed/10x_384px_0px_overlap/slide_features_feather --output-dir ./top200_patches --wsi-root ./wsis
    
  4. Output contents:

    • top200_patches/<case_id>_top_patches/: A folder containing up to 200 PNG images of TOP 200 patches.

💾 Model Weights Download

Download the model weights from HuggingFace Hub NOTE: You need to agree to the terms to access the models and login with your HuggingFace write token:

from huggingface_hub import login
login(<huggingface write token>)    

🏋️ How to use NEVA

  1. Perform inference on your custom dataset using the pretrained weights.

    1. Navigate to ./4_evaluation directory:

      cd ./3_evaluation
      
    2. Run inference script:

      python inference.py --csv_list nmyc --dataset_type cls --image_dir ../1_process_wsi/top200_patches --eval_df path/to/your/eval_csv   
      
    • --dataset_type: cls for classification, reg for Cox regression
    • --csv_list: '1p36', '11q23', 'alk', 'cmyc', 'risk_group', 'mki', 'nmyc', 'shimada', 'subtype', 'os', 'pfs'

    Output: The result of the model inference will be saved in ./eval_results/


Acknowledgements

The project was built on many amazing open-source repositories: TRIDENT, Feather, MUSK. We thank the authors and developers for their contributions.

License

This model and associated code are released under the MIT License.

Citation

If you find our work helpful, feel free to give us a cite.

TODO
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support