default launch code does not support TP4

#10

by bacon36 - opened 15 days ago

with fp4_gemm_runner_backend='b12x'
when running with TP4, qkv_proj got error AssertionError: n=3392 must be divisible by 128,

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment