Commit
•
2761eeb
1
Parent(s):
ecf885a
Update README.md
Browse files
README.md
CHANGED
|
@@ -78,11 +78,12 @@ Breeze-7B-32k-Base clears the tasks with 90+% accuracy, shown in the figure belo
|
|
| 78 |
|
| 79 |
## Use in Transformers
|
| 80 |
|
| 81 |
-
First install direct dependencies:
|
| 82 |
```
|
| 83 |
pip install transformers torch accelerate
|
| 84 |
```
|
| 85 |
<p style="color:red;">Flash-attention2 is strongly recommended for long context scenarios.</p>
|
|
|
|
| 86 |
```bash
|
| 87 |
pip install packaging ninja
|
| 88 |
pip install flash-attn
|
|
|
|
| 78 |
|
| 79 |
## Use in Transformers
|
| 80 |
|
| 81 |
+
First, install direct dependencies:
|
| 82 |
```
|
| 83 |
pip install transformers torch accelerate
|
| 84 |
```
|
| 85 |
<p style="color:red;">Flash-attention2 is strongly recommended for long context scenarios.</p>
|
| 86 |
+
|
| 87 |
```bash
|
| 88 |
pip install packaging ninja
|
| 89 |
pip install flash-attn
|