Alikestocode commited on
Commit
33a1d2e
·
1 Parent(s): e08f8c4

Add note about restarting kernel if AWQModifier errors occur

Browse files

- Users may be running cached old code
- Add reminder to restart kernel and rerun cells
- AWQModifier() works without parameters

Files changed (1) hide show
  1. quantize_to_awq_colab.ipynb +3 -1
quantize_to_awq_colab.ipynb CHANGED
@@ -18,7 +18,9 @@
18
  "- Native vLLM integration (better compatibility)\n",
19
  "- Supports advanced features (pruning, combined modifiers)\n",
20
  "- Actively maintained by vLLM team\n",
21
- "- Optimized for vLLM inference engine\n"
 
 
22
  ]
23
  },
24
  {
 
18
  "- Native vLLM integration (better compatibility)\n",
19
  "- Supports advanced features (pruning, combined modifiers)\n",
20
  "- Actively maintained by vLLM team\n",
21
+ "- Optimized for vLLM inference engine\n",
22
+ "\n",
23
+ "**⚠️ IMPORTANT:** If you see errors about `AWQModifier` parameters, **restart the kernel** (Runtime → Restart runtime) and run all cells from the beginning. The notebook uses `AWQModifier()` without parameters (default 4-bit AWQ).\n"
24
  ]
25
  },
26
  {