hello, I tried running this on 8x 6000 pro, tp 8 and couldn't get it running neither with vllm nor with sglang, do I need certain unmerged pr or special parameters?
· Sign up or log in to comment
