license: other
license_name: nvidia-oneway-noncommercial-license
license_link: LICENSE
Llama3-VILA-M3-13B
Built with Meta Llama 3
Model Overview
Description:
M3 is a medical visual language model that empowers medical imaging professionals, researchers, and healthcare enterprises by enhancing medical imaging workflows across various modalities.
Key features include:
- Integration with expert models from the MONAI Model Zoo
- Support for multiple imaging modalities
For more details, see our repo
Core Capabilities
M3 NIM provides a comprehensive suite of 2D medical image analysis tools, including:
- Segmentation
- Classification
- Visual Question Answering (VQA)
- Report/Findings Generation
These capabilities are applicable across various medical imaging modalities, leveraging expert models from the MONAI Model Zoo to ensure high-quality results.
Model Architecture:
Architecture Type: Auto-Regressive Vision Language Model Network Architecture: VILA with Llama
Input:
Input Type(s): Text and Image Input Format(s): Text: String, Image Input Parameters: Text: 1D, Image: 2D
Output:
Output Type(s): Text and Image Output Format: Text: String and Image Output Parameters: Text: 1D, Image: 2D/3D
Ethical Considerations
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.