ethanfel/MiniMax-H3-Pruned-Ref2VA-Delta-LoRAs-Experimental

MiniMax-H3 pruned FL2VA ↔ Ref2VA delta LoRAs

Highly experimental, mechanically extracted adapters. These are randomized-SVD approximations of the weight difference between the official pruned BF16 Ref2VA and FL2VA checkpoints. They were not trained as LoRAs and have not been generation-tested. Only safetensors integrity and structural loading with ComfyUI's current LoRA parser were validated. Expect artifacts, capability loss, or unpredictable behavior.

These model-only ComfyUI LoRAs explore transferring behavior in either direction between the pruned FL2VA and Ref2VA models. The forward files approximate:

delta = pruned Ref2VA BF16 - pruned FL2VA BF16

The reverse files are exact sign-inverted forms of those approximations:

reverse delta = pruned FL2VA BF16 - pruned Ref2VA BF16

At strength 1.0, applying an adapter to its matching base moves the model toward a rank-limited approximation of the other variant. Lower strengths interpolate only in the extracted weight direction; they do not isolate a clean semantic capability.

Required checkpoints and directions

For files named ref2va_from_fl2va, use this base:

Comfy-Org/MiniMax-H3
diffusion_models/minimax_h3_fl2va_pruned_bf16.safetensors

Base SHA-256:

a32572fb90b5508b201ec7c2eddcc184b13ddfd3c6f6d2cf06a0b46535d541b4

For files named fl2va_from_ref2va, use this base:

diffusion_models/minimax_h3_ref2va_pruned_bf16.safetensors
SHA-256: 37c0da793e20ca735272ec2be655f08a2e10f97a3ec8fdfb40f5b39a736ed6fe

Do not expect correct results with the full-size BF16, FP8, or INT8 checkpoints.

Files

Direction	File	Size	Weighted matrix-delta energy capture
FL2VA → Ref2VA	minimax_h3_ref2va_from_fl2va_pruned_rank256_bf16_lora.safetensors	2.589 GB	99.1260%
FL2VA → Ref2VA	minimax_h3_ref2va_from_fl2va_pruned_rank512_bf16_lora.safetensors	5.075 GB	99.2417%
FL2VA → Ref2VA	minimax_h3_ref2va_from_fl2va_pruned_rank1024_bf16_lora.safetensors	10.048 GB	99.4311%
Ref2VA → FL2VA	minimax_h3_fl2va_from_ref2va_pruned_rank256_bf16_lora.safetensors	2.589 GB	99.1260%
Ref2VA → FL2VA	minimax_h3_fl2va_from_ref2va_pruned_rank512_bf16_lora.safetensors	5.075 GB	99.2417%
Ref2VA → FL2VA	minimax_h3_fl2va_from_ref2va_pruned_rank1024_bf16_lora.safetensors	10.048 GB	99.4311%

The weighted percentage is dominated by high-energy tensors whose effective rank is naturally small. Many large attention and MLP deltas retain substantially less energy, so this statistic is not a quality score. Compare generations with identical prompts, inputs, seeds, and sampler settings.

Each .safetensors.json file contains the complete per-layer extraction report.

ComfyUI use

1. Put one .safetensors file in ComfyUI/models/loras/.
2. Load pruned FL2VA for a ref2va_from_fl2va file, or pruned Ref2VA for a fl2va_from_ref2va file.
3. Apply the adapter with a model-only LoRA loader.
4. Start at model strength 1.0; compare 0.25, 0.5, 0.75, and 1.0 using identical inputs.
5. Do not stack ranks or opposing directions together. They are alternative forms of the same underlying delta.

All six files loaded as 531 expected ComfyUI patches each: 264 matrix adapters and 267 exact vector/bias diff patches. rope.inv_freq was identical between the source checkpoints and was omitted.

Extraction details

• Matrix method: deterministic randomized SVD
• Requested ranks: 256, 512, and 1024
• Oversampling: 32
• Power iterations: 2
• Factor dtype: BF16
• Vector and bias patches: FP32 ComfyUI .diff / .diff_b
• Source tensors: 532 matching tensors
• Peak extractor CUDA allocation: approximately 1.24 GB
• Reverse-direction construction: exact sign inversion of one LoRA factor and every .diff / .diff_b tensor

The included extract_minimax_h3_ref2va_lora.py performs checkpointed, one-tensor-at-a-time extraction. It avoids loading both 40 GB checkpoints into memory simultaneously. invert_comfy_lora_direction.py creates the opposite direction without repeating or degrading the SVD.

License and territorial restrictions

These are modified MiniMax H3 model derivatives. They remain subject to the MiniMax H3 Community License Agreement and its Acceptable Use Policy. The license contains territorial restrictions, redistribution conditions, and use restrictions. Review LICENSE and NOTICE before downloading, using, or redistributing these files.

This repository does not grant additional rights or remove any upstream restriction. Users and distributors are responsible for determining whether their access, use, and redistribution are authorized.

Status

• Experimental: yes
• Trained LoRA: no
• Generation-tested: no
• Structurally parsed by ComfyUI: yes
• Affiliated with or endorsed by MiniMax or Comfy Org: no