Spaces:
Sleeping
Sleeping
Commit
·
33a1d2e
1
Parent(s):
e08f8c4
Add note about restarting kernel if AWQModifier errors occur
Browse files- Users may be running cached old code
- Add reminder to restart kernel and rerun cells
- AWQModifier() works without parameters
quantize_to_awq_colab.ipynb
CHANGED
|
@@ -18,7 +18,9 @@
|
|
| 18 |
"- Native vLLM integration (better compatibility)\n",
|
| 19 |
"- Supports advanced features (pruning, combined modifiers)\n",
|
| 20 |
"- Actively maintained by vLLM team\n",
|
| 21 |
-
"- Optimized for vLLM inference engine\n"
|
|
|
|
|
|
|
| 22 |
]
|
| 23 |
},
|
| 24 |
{
|
|
|
|
| 18 |
"- Native vLLM integration (better compatibility)\n",
|
| 19 |
"- Supports advanced features (pruning, combined modifiers)\n",
|
| 20 |
"- Actively maintained by vLLM team\n",
|
| 21 |
+
"- Optimized for vLLM inference engine\n",
|
| 22 |
+
"\n",
|
| 23 |
+
"**⚠️ IMPORTANT:** If you see errors about `AWQModifier` parameters, **restart the kernel** (Runtime → Restart runtime) and run all cells from the beginning. The notebook uses `AWQModifier()` without parameters (default 4-bit AWQ).\n"
|
| 24 |
]
|
| 25 |
},
|
| 26 |
{
|