[bug]incorrect output
#4
by CHONGYOEYAT - opened
CUDA_DEVICE_ORDER=PCI_BUS_ID
CUDA_VISIBLE_DEVICES=4,5,6,7
vllm serve MiniMax-M3-NVFP4
--served-model-name minimax-m3
--tool-call-parser minimax_m3
--reasoning-parser minimax_m3
--enable-auto-tool-choice
--tensor-parallel-size 4
--gpu-memory-utilization 0.9
--max-model-len -1
--port 14501
--enable-prefix-caching
--enable-chunked-prefill
--block-size 128
--limit-mm-per-prompt.image 1
--limit-mm-per-prompt.video 0
--max-num-seqs 4
with 4x blackwell rtx pro 6000
CHONGYOEYAT changed discussion status to closed
CHONGYOEYAT changed discussion status to open
Exact same issue on the same hardware (4XRTXPRO6000)