SlowGuess/NeurIPS_2023_OCR huggingface dataset:
To sum up, the practical value of DPM-Solver-v3 embodies the following aspects:
1.  $15\sim 30\%$  speed-up can save lots of costs for online text-to-image applications. Our speed-ups are applicable to large text-to-image diffusion models, which are an important part of today's AIGC community. As the recent models become larger, a single NFE requires more computational resources, and  $15\sim 30\%$  speed-up can save a lot of the companies' expenses for commercial usage.
2. Improvement in  $5\sim 10$  NFEs benefits image previewing. Since the samples are controlled by the random seed, coarse samples with  $5\sim 10$  NFEs can be used to preview thousands of samples with low costs and give guidance on choosing the random seed, which can be then used to generate fine samples with best-quality sampling strategies. This is especially useful for text-to-image generation. Since our method achieves better quality and converges faster to the ground-truth sample, it can provide better guidance when used for preview.
K Additional Samples
We provide more visual samples in Figure 9, Figure 10, Figure 11 and Table 14 to demonstrate the qualitative effectiveness of DPM-Solver-v3. It can be seen that the visual quality of DPM-Solver-v3 outperforms previous state-of-the-art solvers. Our method can generate images that have reduced bias (less "shallow"), higher saturation level and more visual details, as mentioned in Section 4.3.
Figure 9: Random samples of ScoreSDE [51] on CIFAR10 dataset [24] with only 5 and 10 NFE.
Heun's 2nd [21]
$\mathrm{NFE} = 5$
FID 320.80
$\mathrm{NFE} = 10$
FID 16.57
DPM-Solver++ [32]
FID 24.54
FID 2.91
UniPC [58]
FID 23.52
FID 2.85
DPM-Solver-v3 (Ours)
FID 12.21
Figure 10: Random samples of EDM [21] on CIFAR10 dataset [24] with only 5 and 10 NFE.
FID 2.51
DPM-Solver++ [32] (FID 11.02)
UniPC [58] (FID 10.19)
DPM-Solver-v3 (Ours) (FID 9.70)
Figure 11: Random samples of Guided-Diffusion [10] on ImageNet-256 dataset [9] with a classifier guidance scale 2.0, using only 7 NFE. We manually remove the potentially disturbing images such as those containing snakes or insects.