Test Concept sliders! Use same way as regular Lora.

Some sliders (Eye, breast size) use weights from -100 to 100. 

https://github.com/rohitgandikota/sliders

ComfyUI workflow
https://github.com/comfyanonymous/ComfyUI/issues/2028#issuecomment-1824812919

Webui extension 
https://github.com/cheald/sd-webui-loractl