sm120 vllm
#2
by festr2 - opened
Hello,
I have working dflash implementafion for sm120 which is now generating over 300 tok/sec (mimo mxfp4 pro2.5) and I would love to test other dflash checkpoints, specifically for glm 5.1 and kimi 2.6? My acc festr2@gmail.com
Hi, and thank you for your Mimo Pro 2.5 model and instructions, it is the only Mimo 2.5 pro version i can run on my 8x sparks cluster. Can you help me add also dflash to it, any link you can point me too, please? And, of course, it would be wonderful to be able to do this also for GLM 5.2 or Minimax M3.. Thanks again!