Test Concept sliders! Use same way as regular Lora.
Some sliders (Eye, breast size) use weights from -100 to 100.
https://github.com/rohitgandikota/sliders
ComfyUI workflow https://github.com/comfyanonymous/ComfyUI/issues/2028#issuecomment-1824812919
Webui extension https://github.com/cheald/sd-webui-loractl