MTP layers missing?
#1
by g-a-b-y - opened
Hello,
I noticed that the MTP/NextN weights appear to be missing from the checkpoint.
Also is the FP8 kv cache calibrated?
Ping @shengliangx
Hello,
I noticed that the MTP/NextN weights appear to be missing from the checkpoint.
Also is the FP8 kv cache calibrated?
Ping @shengliangx