Update README.md
Browse files
README.md
CHANGED
|
@@ -95,7 +95,7 @@ whereas the general (non-orthogonal) "multiplicative-LoRA" method can (in theory
|
|
| 95 |
|
| 96 |
`h' = h + u @ v^T @ h`
|
| 97 |
|
| 98 |
-
|
| 99 |
|
| 100 |
`h' = h - 2 * v @ v^T @ h`
|
| 101 |
|
|
|
|
| 95 |
|
| 96 |
`h' = h + u @ v^T @ h`
|
| 97 |
|
| 98 |
+
This general (non-orthogonal) "multiplicative-LoRA" method can also (in theory) perform [Householder Transformation(s)](https://en.wikipedia.org/wiki/Householder_transformation):
|
| 99 |
|
| 100 |
`h' = h - 2 * v @ v^T @ h`
|
| 101 |
|