Update README.md
Browse files
README.md
CHANGED
@@ -106,7 +106,7 @@ So instead of having just a single vector that we add (and in essence adding a b
|
|
106 |
|
107 |

|
108 |
|
109 |
-
but where `lora_A` looks at the ***input*** to the transformation; instead of the ***output*** of the (`down_proj`) transformation like these new (non-orthogonal) "multiplicative-LoRAs"
|
110 |
|
111 |
---
|
112 |
|
|
|
106 |
|
107 |

|
108 |
|
109 |
+
but where `lora_A` looks at the ***input*** to the transformation; instead of the ***output*** of the (`down_proj`) transformation like these new (non-orthogonal) "multiplicative-LoRAs"...
|
110 |
|
111 |
---
|
112 |
|