Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ license: apache-2.0
|
|
| 11 |
|
| 12 |
The following changes have been made:
|
| 13 |
- Fixing generation configuration setting
|
| 14 |
-
- Model now properly uses specified ```attention_mask``` when calling ```scaled_dot_product_attention``` - this also allows to specify custom attention masks and work with left-padded input.
|
| 15 |
|
| 16 |
|
| 17 |
# 🚀 Falcon-7B
|
|
|
|
| 11 |
|
| 12 |
The following changes have been made:
|
| 13 |
- Fixing generation configuration setting
|
| 14 |
+
- Model now properly uses specified ```attention_mask``` when calling ```scaled_dot_product_attention``` - this also allows to specify custom attention masks and work with left-padded input. However, this will disable additional memory and flash optimization.
|
| 15 |
|
| 16 |
|
| 17 |
# 🚀 Falcon-7B
|