| # You Only Sample Once (YOSO) | |
| This algorithm was proposed in YOSO. | |
| This model is fine-tuning from PixArt, enabling one-step inference to perform text-to-image generation. | |
| ## usage | |
| ```python | |
| from diffusers import PixArtAlphaPipeline, LCMScheduler, Transformer2DModel, DPMSolverMultistepScheduler | |
| transformer = Transformer2DModel.from_pretrained( | |
| "Yihong666/yoso_pixart512", torch_dtype=torch.float16).to('cuda') | |
| pipe = PixArtAlphaPipeline.from_pretrained("./models--PixArt-alpha--PixArt-XL-2-512x512", | |
| transformer=transformer, | |
| torch_dtype=torch.float16, use_safetensors=True) | |
| pipe = pipe.to('cuda') | |
| pipe.scheduler = LCMScheduler.from_config(pipe.scheduler.config) | |
| pipe.scheduler.config.prediction_type = "v_prediction" | |
| generator = torch.manual_seed(318) | |
| imgs = pipe(prompt="Pirate ship trapped in a cosmic maelstrom nebula, rendered in cosmic beach whirlpool engine, volumetric lighting, spectacular, ambient lights, light pollution, cinematic atmosphere, art nouveau style, illustration art artwork by SenseiJaye, intricate detail.", | |
| num_inference_steps=1, | |
| num_images_per_prompt = 1, | |
| generator = generator, | |
| guidance_scale=1., | |
| )[0] | |
| imgs[0] | |
| ``` | |
|  |