pharmapsychotic commited on
Commit
6bae04c
1 Parent(s): 64dedd7

Initial placeholder benchmark table.

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -10,6 +10,7 @@ tags:
10
 
11
  # Stable Diffusion XL 1.0 TensorRT
12
 
 
13
  This repository contains Stable Diffusion XL 1.0 ONNX models compatible with TensorRT.
14
 
15
  Source models:
@@ -17,9 +18,19 @@ Source models:
17
  - [SDXL refiner 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0)
18
 
19
 
 
 
 
 
 
 
 
 
 
20
  ### Model Description
21
 
22
  - **Developed by:** Stability AI
23
  - **Model type:** Diffusion-based text-to-image generative model
24
  - **License:** [CreativeML Open RAIL++-M License](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/blob/main/LICENSE.md)
25
  - **Model Description:** This is a conversion of the [Stable Diffusion XL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) model for [NVIDIA TensorRT](https://developer.nvidia.com/tensorrt) optimized inference
 
 
10
 
11
  # Stable Diffusion XL 1.0 TensorRT
12
 
13
+ ### Introduction
14
  This repository contains Stable Diffusion XL 1.0 ONNX models compatible with TensorRT.
15
 
16
  Source models:
 
18
  - [SDXL refiner 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0)
19
 
20
 
21
+ ### Benchmark
22
+
23
+ Timings at 1024x1024
24
+ | | CLIP | UNet 40 steps | VAE decode | Pipline | Throughput |
25
+ |------|---------|---------------|------------|-------------|--------------|
26
+ | A10 | 8.98 ms | 12576.53 ms | 0.00 ms | 12588.26 ms | 0.08 image/s |
27
+ | A100 | 5.99 ms | 3358.87 ms | 0.00 ms | 3367.04 ms | 0.30 image/s |
28
+ | H100 | 4.70 ms | 1772.29 ms | 0.00 ms | 1779.01 ms | 0.56 image/s |
29
+
30
  ### Model Description
31
 
32
  - **Developed by:** Stability AI
33
  - **Model type:** Diffusion-based text-to-image generative model
34
  - **License:** [CreativeML Open RAIL++-M License](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/blob/main/LICENSE.md)
35
  - **Model Description:** This is a conversion of the [Stable Diffusion XL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) model for [NVIDIA TensorRT](https://developer.nvidia.com/tensorrt) optimized inference
36
+