Change PowerInfer URL
Browse files
README.md
CHANGED
@@ -81,7 +81,7 @@ Our evaluation is based on the framework lm-evaluation-harness and opencompass.
|
|
81 |
|
82 |
## Inference Speed Evaluation Results
|
83 |
|
84 |
-
We utilize [PowerInfer](https://
|
85 |
Here we show the inference speed compared with llama.cpp/transformers.
|
86 |
|
87 |
## Limitation & Disclaimer
|
|
|
81 |
|
82 |
## Inference Speed Evaluation Results
|
83 |
|
84 |
+
We utilize [PowerInfer](https://github.com/SJTU-IPADS/PowerInfer), a state-of-the-art acceleration framework leveraging activation sparsity.
|
85 |
Here we show the inference speed compared with llama.cpp/transformers.
|
86 |
|
87 |
## Limitation & Disclaimer
|