add marlin install
Browse files
README.md
CHANGED
|
@@ -27,6 +27,7 @@ This model doesn't use grouping to make it compatible with all the kernels that
|
|
| 27 |
First, install the latest version of <a href="https://github.com/mobiusml/hqq/">HQQ</a>:
|
| 28 |
```
|
| 29 |
pip install git+https://github.com/mobiusml/hqq.git
|
|
|
|
| 30 |
```
|
| 31 |
Make sure you use `pip install transformers==4.39.0`
|
| 32 |
|
|
|
|
| 27 |
First, install the latest version of <a href="https://github.com/mobiusml/hqq/">HQQ</a>:
|
| 28 |
```
|
| 29 |
pip install git+https://github.com/mobiusml/hqq.git
|
| 30 |
+
pip install git+https://github.com/IST-DASLab/marlin.git #to use the marlin backend
|
| 31 |
```
|
| 32 |
Make sure you use `pip install transformers==4.39.0`
|
| 33 |
|