Instructions to use stabilityai/stable-diffusion-3.5-medium-amdnpu-medusa with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use stabilityai/stable-diffusion-3.5-medium-amdnpu-medusa with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-3.5-medium-amdnpu-medusa", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
π Stable Diffusion 3.5 Medium on AMD NPU
"Stable Diffusion 3.5 Medium is an improved version of SD3 Medium, featuring better prompt adherence, better generation quality, and more diverse outputs. SD3.5 Medium is a Multimodal Diffusion Transformer (MMDiT) text-to-image model that features improved image quality, typography, and prompt understanding." (stabilityai/stable-diffusion-3.5-medium)
This version of the model has been optimized to run on AMD NPUs.
For more information, refer to the original model card under stabilityai/stable-diffusion-3.5-medium.
M1.0 variant: This repository contains the M1.0-optimized NPU model derived from amd/stable-diffusion-3.5-medium-amdnpu.
Model Details
The folder structure is organized around the shared (common) pipeline components and the text-to-image transformer (normal).
ββ common/
β ββ scheduler/
β ββ text_encoder/
β ββ text_encoder_2/
β ββ text_encoder_3/
β ββ text_encoder_3_int4/
β ββ tokenizer/
β ββ tokenizer_2/
β ββ tokenizer_3/
β ββ vae_decoder/
β ββ vae_encoder/
ββ normal/
ββ transformer/
The scheduler folder contains the scheduler configuration used during the diffusion sampling process.
The text_encoder, text_encoder_2, text_encoder_3, and text_encoder_3_int4 folders contain the CLIP and T5 text encoder models (including the INT4 T5 variant) used to convert the input prompt into conditioning embeddings.
The tokenizer, tokenizer_2, and tokenizer_3 folders contain the tokenizer configuration and vocabulary files required to preprocess text prompts for the respective text encoders.
The transformer folder contains the MMDiT transformer model used in the diffusion process. The transformer is exported and structured specifically to leverage the AMD NPU accelerator for the denoising steps.
The vae_decoder folder contains the VAE decoder model used to map latent representations back to the image space. The VAE decoder is also structured to make use of the NPU accelerator for efficient image reconstruction.
The vae_encoder folder contains the VAE encoder model used for image-to-latent conversion.
Note: Transformer and VAE decoder models are optimized and structured to run on AMD NPUs. The other components (text encoders, tokenizers and scheduler) are shared between GPU and NPU pipelines, but are provided here for completeness.
| Model Details | Description |
|---|---|
| Person or organization developing model | AMD |
| Original model authors | Stability AI |
| Model date | October 2026 |
| Model version | 1.8.0 |
| Model type | Diffusion-based text-to-image generation model |
| Information about training algorithms, parameters, fairness constraints or other applied approaches, and features | This is a model that can be used to generate and modify images based on text prompts. |
| License | Stability AI Community |
| Where to send questions or comments about the model | Community Tab and AMD Developer Community Discord |
β‘ Intended Use
Getting Started
To get started with this model, visit github.com/amd/sd-sandbox.
β Ethical Considerations
AMD is committed to conducting our business in a fair, ethical and honest manner and in compliance with all applicable laws, rules and regulations. You can find out more at the AMD Ethics and Compliance page.
β οΈ Caveats and Recommendations
Please visit the original model card for more details: stabilityai/stable-diffusion-3.5-medium.
- Downloads last month
- -