好像lmdeploy无法加速推理8bit版本?
#6 opened 20 days ago
by
yuezhiyu
是否会有4bit版本呢?
1
#5 opened about 2 months ago
by
praymich
只文本对话
1
#2 opened 2 months ago
by
lixiang112
多gpu推理有bug
3
#1 opened 2 months ago
by
timecome