Neon Illustration Diffusion
This fine-tuned Stable Diffusion v1.5 model was trained for 11000 iterations on a selection of artistic works by Pachu M. Torres. Training was performed using ShivamShrirao/diffusers with full precision, prior-preservation loss, the train-text-encoder feature, and the new 1.5 MSE VAE from Stability AI. A total of 4120 regularization / class images were used from here. Regularization images were generated using the prompt "artwork style", 50 DDIM steps, and a CFG of 7.
Use the tokens nlust style in your prompts for the effect. The effect also appears to occur at a much weaker strength on prompts that steer the output towards specific artistic styles, resulting in a completely new artistic style!