--- license: openrail++ language: - en tags: - stable-diffusion - tensorrt - text-to-image --- # Stable Diffusion XL 1.0 TensorRT ### Introduction This repository contains Stable Diffusion XL 1.0 ONNX models compatible with TensorRT. Source models: - [SDXL base 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) - [SDXL refiner 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0) ### Benchmark Timings at 1024x1024 | | CLIP | UNet 40 steps | VAE decode | Pipline | Throughput | |------|---------|---------------|------------|-------------|--------------| | A10 | 8.98 ms | 12576.53 ms | 0.00 ms | 12588.26 ms | 0.08 image/s | | A100 | 5.99 ms | 3358.87 ms | 0.00 ms | 3367.04 ms | 0.30 image/s | | H100 | 4.70 ms | 1772.29 ms | 0.00 ms | 1779.01 ms | 0.56 image/s | ### Model Description - **Developed by:** Stability AI - **Model type:** Diffusion-based text-to-image generative model - **License:** [CreativeML Open RAIL++-M License](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/blob/main/LICENSE.md) - **Model Description:** This is a conversion of the [Stable Diffusion XL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) model for [NVIDIA TensorRT](https://developer.nvidia.com/tensorrt) optimized inference