sglang和vllm运行目前不支持blockwise_int8

#12
by zhangneilc - opened

sglang和vllm运行目前不支持blockwise_int8,这个怎么解

meituan org

sglang支持了,看下我们的PR: https://github.com/sgl-project/sglang/pull/3730

pkumc changed discussion status to closed

Sign up or log in to comment