ArneshBanerjee

/

Kimi-K3-for-All

like 1

~18% less then classic scale low demands means suboptimal GPU utilization. So please try to scale down, say 24 Layers prune half.

Please share continued pretrain script (withut hardcoded wikipedia)

Thanks for you efforts and results!