Spaces:
Running
Running
Update app.py
Browse files
app.py
CHANGED
|
@@ -282,10 +282,9 @@ This tool merges LoRA (Low-Rank Adaptation) adapters with base models using a me
|
|
| 282 |
|
| 283 |
DETAILS_TEXT = """
|
| 284 |
### How It Works
|
| 285 |
-
LoRA enables efficient fine-tuning by adding small adapter weights rather than modifying the entire model
|
| 286 |
|
| 287 |
-
|
| 288 |
-
- Negative scale values reverse the effect
|
| 289 |
|
| 290 |
### Scale Factor
|
| 291 |
The scale factor (-2 ≤ scale ≤ 2) controls the strength of the LoRA merge:
|
|
|
|
| 282 |
|
| 283 |
DETAILS_TEXT = """
|
| 284 |
### How It Works
|
| 285 |
+
LoRA enables efficient fine-tuning by adding small adapter weights rather than modifying the entire model:
|
| 286 |
|
| 287 |
+
`W_new = W + scale × (α/r) × B @ A`
|
|
|
|
| 288 |
|
| 289 |
### Scale Factor
|
| 290 |
The scale factor (-2 ≤ scale ≤ 2) controls the strength of the LoRA merge:
|