Diffusers

Krea 2 Raw nvfp4 converted using silveroxides/convert_to_quant (ctq CLI) with ComfyUI-compatible metadata.

uv run --with  convert-to-quant --with triton ctq -i '/mnt/500c/models/diffusion/krea2/krea2_raw_bf16.safetensors' -o '/mnt/500c/models/diffusion/krea2/krea2_raw_nvfp4.safetensors'  --nvfp4 --comfy_quant --save-quant-metadata --simple --low-memory --krea2
Using seed: 2544867547
Processing: /mnt/500c/models/diffusion/krea2/krea2_raw_bf16.safetensors
Output will be saved to: /mnt/500c/models/diffusion/krea2/krea2_raw_nvfp4.safetensors
------------------------------------------------------------
Target format: NVFP4 (FP4 E2M1 block quantization)
Block size: 16
------------------------------------------------------------
NVFP4 Simple mode (no learned rounding optimization)
Low-memory mode: found 430 tensors (streaming)
[MINIMAL] Scanning model and generating simulated calibration data...
Simulated calibration data generated.

Found 264 weight tensors to potentially process.
------------------------------------------------------------
(1/264) Processing tensor: blocks.0.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(2/264) Processing tensor: blocks.0.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(3/264) Processing tensor: blocks.0.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(4/264) Processing tensor: blocks.0.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(5/264) Processing tensor: blocks.0.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(6/264) Processing tensor: blocks.0.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(7/264) Processing tensor: blocks.0.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(8/264) Processing tensor: blocks.0.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(9/264) Processing tensor: blocks.1.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(10/264) Processing tensor: blocks.1.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(11/264) Processing tensor: blocks.1.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(12/264) Processing tensor: blocks.1.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(13/264) Processing tensor: blocks.1.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(14/264) Processing tensor: blocks.1.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(15/264) Processing tensor: blocks.1.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(16/264) Processing tensor: blocks.1.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(17/264) Processing tensor: blocks.10.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(18/264) Processing tensor: blocks.10.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(19/264) Processing tensor: blocks.10.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(20/264) Processing tensor: blocks.10.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(21/264) Processing tensor: blocks.10.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(22/264) Processing tensor: blocks.10.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(23/264) Processing tensor: blocks.10.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(24/264) Processing tensor: blocks.10.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(25/264) Processing tensor: blocks.11.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(26/264) Processing tensor: blocks.11.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(27/264) Processing tensor: blocks.11.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(28/264) Processing tensor: blocks.11.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(29/264) Processing tensor: blocks.11.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(30/264) Processing tensor: blocks.11.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(31/264) Processing tensor: blocks.11.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(32/264) Processing tensor: blocks.11.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(33/264) Processing tensor: blocks.12.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(34/264) Processing tensor: blocks.12.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(35/264) Processing tensor: blocks.12.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(36/264) Processing tensor: blocks.12.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(37/264) Processing tensor: blocks.12.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(38/264) Processing tensor: blocks.12.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(39/264) Processing tensor: blocks.12.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(40/264) Processing tensor: blocks.12.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(41/264) Processing tensor: blocks.13.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(42/264) Processing tensor: blocks.13.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(43/264) Processing tensor: blocks.13.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(44/264) Processing tensor: blocks.13.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(45/264) Processing tensor: blocks.13.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(46/264) Processing tensor: blocks.13.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(47/264) Processing tensor: blocks.13.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(48/264) Processing tensor: blocks.13.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(49/264) Processing tensor: blocks.14.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(50/264) Processing tensor: blocks.14.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(51/264) Processing tensor: blocks.14.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(52/264) Processing tensor: blocks.14.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(53/264) Processing tensor: blocks.14.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(54/264) Processing tensor: blocks.14.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(55/264) Processing tensor: blocks.14.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(56/264) Processing tensor: blocks.14.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(57/264) Processing tensor: blocks.15.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(58/264) Processing tensor: blocks.15.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(59/264) Processing tensor: blocks.15.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(60/264) Processing tensor: blocks.15.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(61/264) Processing tensor: blocks.15.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(62/264) Processing tensor: blocks.15.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(63/264) Processing tensor: blocks.15.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(64/264) Processing tensor: blocks.15.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(65/264) Processing tensor: blocks.16.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(66/264) Processing tensor: blocks.16.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(67/264) Processing tensor: blocks.16.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(68/264) Processing tensor: blocks.16.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(69/264) Processing tensor: blocks.16.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(70/264) Processing tensor: blocks.16.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(71/264) Processing tensor: blocks.16.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(72/264) Processing tensor: blocks.16.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(73/264) Processing tensor: blocks.17.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(74/264) Processing tensor: blocks.17.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(75/264) Processing tensor: blocks.17.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(76/264) Processing tensor: blocks.17.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(77/264) Processing tensor: blocks.17.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(78/264) Processing tensor: blocks.17.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(79/264) Processing tensor: blocks.17.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(80/264) Processing tensor: blocks.17.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(81/264) Processing tensor: blocks.18.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(82/264) Processing tensor: blocks.18.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(83/264) Processing tensor: blocks.18.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(84/264) Processing tensor: blocks.18.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(85/264) Processing tensor: blocks.18.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(86/264) Processing tensor: blocks.18.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(87/264) Processing tensor: blocks.18.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(88/264) Processing tensor: blocks.18.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(89/264) Processing tensor: blocks.19.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(90/264) Processing tensor: blocks.19.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(91/264) Processing tensor: blocks.19.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(92/264) Processing tensor: blocks.19.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(93/264) Processing tensor: blocks.19.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(94/264) Processing tensor: blocks.19.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(95/264) Processing tensor: blocks.19.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(96/264) Processing tensor: blocks.19.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(97/264) Processing tensor: blocks.2.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(98/264) Processing tensor: blocks.2.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(99/264) Processing tensor: blocks.2.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(100/264) Processing tensor: blocks.2.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(101/264) Processing tensor: blocks.2.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(102/264) Processing tensor: blocks.2.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(103/264) Processing tensor: blocks.2.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(104/264) Processing tensor: blocks.2.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(105/264) Processing tensor: blocks.20.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(106/264) Processing tensor: blocks.20.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(107/264) Processing tensor: blocks.20.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(108/264) Processing tensor: blocks.20.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(109/264) Processing tensor: blocks.20.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(110/264) Processing tensor: blocks.20.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(111/264) Processing tensor: blocks.20.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(112/264) Processing tensor: blocks.20.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(113/264) Processing tensor: blocks.21.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(114/264) Processing tensor: blocks.21.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(115/264) Processing tensor: blocks.21.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(116/264) Processing tensor: blocks.21.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(117/264) Processing tensor: blocks.21.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(118/264) Processing tensor: blocks.21.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(119/264) Processing tensor: blocks.21.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(120/264) Processing tensor: blocks.21.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(121/264) Processing tensor: blocks.22.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(122/264) Processing tensor: blocks.22.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(123/264) Processing tensor: blocks.22.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(124/264) Processing tensor: blocks.22.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(125/264) Processing tensor: blocks.22.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(126/264) Processing tensor: blocks.22.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(127/264) Processing tensor: blocks.22.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(128/264) Processing tensor: blocks.22.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(129/264) Processing tensor: blocks.23.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(130/264) Processing tensor: blocks.23.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(131/264) Processing tensor: blocks.23.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(132/264) Processing tensor: blocks.23.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(133/264) Processing tensor: blocks.23.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(134/264) Processing tensor: blocks.23.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(135/264) Processing tensor: blocks.23.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(136/264) Processing tensor: blocks.23.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(137/264) Processing tensor: blocks.24.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(138/264) Processing tensor: blocks.24.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(139/264) Processing tensor: blocks.24.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(140/264) Processing tensor: blocks.24.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(141/264) Processing tensor: blocks.24.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(142/264) Processing tensor: blocks.24.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(143/264) Processing tensor: blocks.24.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(144/264) Processing tensor: blocks.24.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(145/264) Processing tensor: blocks.25.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(146/264) Processing tensor: blocks.25.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(147/264) Processing tensor: blocks.25.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(148/264) Processing tensor: blocks.25.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(149/264) Processing tensor: blocks.25.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(150/264) Processing tensor: blocks.25.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(151/264) Processing tensor: blocks.25.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(152/264) Processing tensor: blocks.25.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(153/264) Processing tensor: blocks.26.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(154/264) Processing tensor: blocks.26.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(155/264) Processing tensor: blocks.26.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(156/264) Processing tensor: blocks.26.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(157/264) Processing tensor: blocks.26.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(158/264) Processing tensor: blocks.26.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(159/264) Processing tensor: blocks.26.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(160/264) Processing tensor: blocks.26.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(161/264) Processing tensor: blocks.27.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(162/264) Processing tensor: blocks.27.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(163/264) Processing tensor: blocks.27.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(164/264) Processing tensor: blocks.27.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(165/264) Processing tensor: blocks.27.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(166/264) Processing tensor: blocks.27.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(167/264) Processing tensor: blocks.27.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(168/264) Processing tensor: blocks.27.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(169/264) Processing tensor: blocks.3.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(170/264) Processing tensor: blocks.3.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(171/264) Processing tensor: blocks.3.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(172/264) Processing tensor: blocks.3.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(173/264) Processing tensor: blocks.3.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(174/264) Processing tensor: blocks.3.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(175/264) Processing tensor: blocks.3.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(176/264) Processing tensor: blocks.3.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(177/264) Processing tensor: blocks.4.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(178/264) Processing tensor: blocks.4.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(179/264) Processing tensor: blocks.4.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(180/264) Processing tensor: blocks.4.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(181/264) Processing tensor: blocks.4.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(182/264) Processing tensor: blocks.4.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(183/264) Processing tensor: blocks.4.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(184/264) Processing tensor: blocks.4.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(185/264) Processing tensor: blocks.5.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(186/264) Processing tensor: blocks.5.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(187/264) Processing tensor: blocks.5.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(188/264) Processing tensor: blocks.5.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(189/264) Processing tensor: blocks.5.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(190/264) Processing tensor: blocks.5.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(191/264) Processing tensor: blocks.5.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(192/264) Processing tensor: blocks.5.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(193/264) Processing tensor: blocks.6.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(194/264) Processing tensor: blocks.6.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(195/264) Processing tensor: blocks.6.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(196/264) Processing tensor: blocks.6.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(197/264) Processing tensor: blocks.6.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(198/264) Processing tensor: blocks.6.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(199/264) Processing tensor: blocks.6.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(200/264) Processing tensor: blocks.6.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(201/264) Processing tensor: blocks.7.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(202/264) Processing tensor: blocks.7.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(203/264) Processing tensor: blocks.7.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(204/264) Processing tensor: blocks.7.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(205/264) Processing tensor: blocks.7.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(206/264) Processing tensor: blocks.7.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(207/264) Processing tensor: blocks.7.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(208/264) Processing tensor: blocks.7.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(209/264) Processing tensor: blocks.8.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(210/264) Processing tensor: blocks.8.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(211/264) Processing tensor: blocks.8.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(212/264) Processing tensor: blocks.8.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(213/264) Processing tensor: blocks.8.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(214/264) Processing tensor: blocks.8.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(215/264) Processing tensor: blocks.8.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(216/264) Processing tensor: blocks.8.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(217/264) Processing tensor: blocks.9.attn.gate.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(218/264) Processing tensor: blocks.9.attn.wk.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(219/264) Processing tensor: blocks.9.attn.wo.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(220/264) Processing tensor: blocks.9.attn.wq.weight
    - Final Weight shape      : [6144, 3072]
    - Final Block Scale shape : [6144, 384]
------------------------------------------------------------
(221/264) Processing tensor: blocks.9.attn.wv.weight
    - Final Weight shape      : [1536, 3072]
    - Final Block Scale shape : [1536, 384]
------------------------------------------------------------
(222/264) Processing tensor: blocks.9.mlp.down.weight
    - Final Weight shape      : [6144, 8192]
    - Final Block Scale shape : [6144, 1024]
------------------------------------------------------------
(223/264) Processing tensor: blocks.9.mlp.gate.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(224/264) Processing tensor: blocks.9.mlp.up.weight
    - Final Weight shape      : [16384, 3072]
    - Final Block Scale shape : [16384, 384]
------------------------------------------------------------
(225/264) Skipping tensor: first.weight (Reason: Exclusion pattern match)
(226/264) Skipping tensor: last.linear.weight (Reason: Exclusion pattern match)
(227/264) Skipping tensor: tmlp.0.weight (Reason: Exclusion pattern match)
(228/264) Skipping tensor: tmlp.2.weight (Reason: Exclusion pattern match)
(229/264) Skipping tensor: tproj.1.weight (Reason: Exclusion pattern match)
(230/264) Skipping tensor: txtfusion.layerwise_blocks.0.attn.gate.weight (Reason: Exclusion pattern match)
(231/264) Skipping tensor: txtfusion.layerwise_blocks.0.attn.wk.weight (Reason: Exclusion pattern match)
(232/264) Skipping tensor: txtfusion.layerwise_blocks.0.attn.wo.weight (Reason: Exclusion pattern match)
(233/264) Skipping tensor: txtfusion.layerwise_blocks.0.attn.wq.weight (Reason: Exclusion pattern match)
(234/264) Skipping tensor: txtfusion.layerwise_blocks.0.attn.wv.weight (Reason: Exclusion pattern match)
(235/264) Skipping tensor: txtfusion.layerwise_blocks.0.mlp.down.weight (Reason: Exclusion pattern match)
(236/264) Skipping tensor: txtfusion.layerwise_blocks.0.mlp.gate.weight (Reason: Exclusion pattern match)
(237/264) Skipping tensor: txtfusion.layerwise_blocks.0.mlp.up.weight (Reason: Exclusion pattern match)
(238/264) Skipping tensor: txtfusion.layerwise_blocks.1.attn.gate.weight (Reason: Exclusion pattern match)
(239/264) Skipping tensor: txtfusion.layerwise_blocks.1.attn.wk.weight (Reason: Exclusion pattern match)
(240/264) Skipping tensor: txtfusion.layerwise_blocks.1.attn.wo.weight (Reason: Exclusion pattern match)
(241/264) Skipping tensor: txtfusion.layerwise_blocks.1.attn.wq.weight (Reason: Exclusion pattern match)
(242/264) Skipping tensor: txtfusion.layerwise_blocks.1.attn.wv.weight (Reason: Exclusion pattern match)
(243/264) Skipping tensor: txtfusion.layerwise_blocks.1.mlp.down.weight (Reason: Exclusion pattern match)
(244/264) Skipping tensor: txtfusion.layerwise_blocks.1.mlp.gate.weight (Reason: Exclusion pattern match)
(245/264) Skipping tensor: txtfusion.layerwise_blocks.1.mlp.up.weight (Reason: Exclusion pattern match)
(246/264) Skipping tensor: txtfusion.projector.weight (Reason: Exclusion pattern match)
(247/264) Skipping tensor: txtfusion.refiner_blocks.0.attn.gate.weight (Reason: Exclusion pattern match)
(248/264) Skipping tensor: txtfusion.refiner_blocks.0.attn.wk.weight (Reason: Exclusion pattern match)
(249/264) Skipping tensor: txtfusion.refiner_blocks.0.attn.wo.weight (Reason: Exclusion pattern match)
(250/264) Skipping tensor: txtfusion.refiner_blocks.0.attn.wq.weight (Reason: Exclusion pattern match)
(251/264) Skipping tensor: txtfusion.refiner_blocks.0.attn.wv.weight (Reason: Exclusion pattern match)
(252/264) Skipping tensor: txtfusion.refiner_blocks.0.mlp.down.weight (Reason: Exclusion pattern match)
(253/264) Skipping tensor: txtfusion.refiner_blocks.0.mlp.gate.weight (Reason: Exclusion pattern match)
(254/264) Skipping tensor: txtfusion.refiner_blocks.0.mlp.up.weight (Reason: Exclusion pattern match)
(255/264) Skipping tensor: txtfusion.refiner_blocks.1.attn.gate.weight (Reason: Exclusion pattern match)
(256/264) Skipping tensor: txtfusion.refiner_blocks.1.attn.wk.weight (Reason: Exclusion pattern match)
(257/264) Skipping tensor: txtfusion.refiner_blocks.1.attn.wo.weight (Reason: Exclusion pattern match)
(258/264) Skipping tensor: txtfusion.refiner_blocks.1.attn.wq.weight (Reason: Exclusion pattern match)
(259/264) Skipping tensor: txtfusion.refiner_blocks.1.attn.wv.weight (Reason: Exclusion pattern match)
(260/264) Skipping tensor: txtfusion.refiner_blocks.1.mlp.down.weight (Reason: Exclusion pattern match)
(261/264) Skipping tensor: txtfusion.refiner_blocks.1.mlp.gate.weight (Reason: Exclusion pattern match)
(262/264) Skipping tensor: txtfusion.refiner_blocks.1.mlp.up.weight (Reason: Exclusion pattern match)
(263/264) Skipping tensor: txtmlp.1.weight (Reason: Exclusion pattern match)
(264/264) Skipping tensor: txtmlp.3.weight (Reason: Exclusion pattern match)

Saving 1102 tensors to /mnt/500c/models/diffusion/krea2/krea2_raw_nvfp4.safetensors
------------------------------------------------------------
Summary:
  - Original tensor count : 430
  - Weights processed     : 224
  - Weights skipped       : 40
  - Final tensor count    : 1102
------------------------------------------------------------
Conversion complete!
Downloads last month
5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for rockerBOO/krea2-raw-nvfp4

Base model

krea/Krea-2-Raw
Quantized
(10)
this model