Instructions to use unsloth/MiniMax-H3-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Studio
How to use unsloth/MiniMax-H3-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/MiniMax-H3-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for unsloth/MiniMax-H3-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for unsloth/MiniMax-H3-GGUF to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="unsloth/MiniMax-H3-GGUF", max_seq_length=2048, )
MiniMax-H3 GGUF
GGUF for MiniMax-H3, compatible on most platforms including stablediffusion.cpp, ComfyUI, Unsloth and more.
Run MiniMax-H3 via Unsloth
You can run MiniMax-H3 via Unsloth: https://github.com/unslothai/unsloth/
GGUF quantizations of MiniMaxAI/MiniMax-H3
MiniMax H3 is an omni-modal generative system that produces video with native stereo audio, up to
15 seconds at 24 FPS with 32 kHz stereo audio. The files here quantize the fl2va_pruned H3-Base
first-and-last-frame variant, which takes zero, one or two input images plus text. Both halves of
the runtime are in this repo: the denoiser and the Qwen3-VL text encoder it needs.
Example
UD-Q2_K_XL, the smallest rung here, at 960x544, 124 frames, 24 FPS, 8 steps, guidance 1.0,
seed 11, on a single card.
a red panda stepping along a mossy log in a misty forest, cinematic
The GIF is downsampled and silent. For the full 960x544 clip with its native 32 kHz stereo audio
track, play
assets/h3_gguf_ud_q2_k_xl.mp4.
H3 generates the audio jointly with the video, so the audio is part of the model output rather
than something added afterwards.
Files
| File | Size |
|---|---|
minimax_h3_fl2va_pruned-Q2_K.gguf |
6.26 GiB |
minimax_h3_fl2va_pruned-UD-Q2_K_XL.gguf |
7.51 GiB |
minimax_h3_fl2va_pruned-Q3_K.gguf |
8.16 GiB |
minimax_h3_fl2va_pruned-UD-Q3_K_XL.gguf |
8.90 GiB |
minimax_h3_fl2va_pruned-Q4_K.gguf |
10.64 GiB |
minimax_h3_fl2va_pruned-Q5_0.gguf |
12.97 GiB |
minimax_h3_fl2va_pruned-Q6_K.gguf |
15.45 GiB |
minimax_h3_fl2va_pruned-Q8_0.gguf |
19.97 GiB |
qwen3vl_32b_minimax_h3-Q2_K_M.gguf |
12.20 GiB |
qwen3vl_32b_minimax_h3-Q4_K_M.gguf |
16.97 GiB |
The UD- rungs are dynamic, mixed-precision builds. The uniform rungs hold one type throughout.
Pair the Q2_K_M text encoder with the two smallest denoisers and the Q4_K_M one with everything
else. The VAEs are not duplicated here, take them from
Comfy-Org/MiniMax-H3.
sd-cli --mode vid_gen \
--diffusion-model minimax_h3_fl2va_pruned-UD-Q2_K_XL.gguf \
--llm qwen3vl_32b_minimax_h3-Q2_K_M.gguf \
--vae minimax_h3_video_vae_fp16.safetensors \
--audio-vae minimax_h3_audio_vae_fp32.safetensors \
--prompt "a red fox trotting through falling snow, cinematic" \
--width 640 --height 384 --video-frames 25 --steps 4 --cfg-scale 1.0 \
--backend te=cpu --diffusion-fa \
--output out.webm
Three flags are not optional. --mode vid_gen, or H3 takes the image path and aborts. Explicit
--cfg-scale 1.0, because H3 is distilled and cfg-free and aborts above 1.0 while the default is
7.0. And --backend te=cpu, which keeps the 12 GB text encoder off the card. Add
--offload-to-cpu to fit a smaller GPU.
The pre-quantized PyTorch checkpoints are in unsloth/MiniMax-H3-FP8.
Licence
MiniMax H3 Community License Agreement, from MiniMax-H3. Full text in
LICENSE. Read it before use:
it defines an Applicable Territory and excludes some jurisdictions from it. MiniMax also publish a
Q&A about the licence.
These files are Model Derivatives, not a plain copy: the transformer and the text encoder are
quantized, which changes the numerics. Section III of the licence wants that stated, so
NOTICE lists every change
along with the attribution. Not an official MiniMax product, and not endorsed by MiniMax.
- Downloads last month
- 15
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Model tree for unsloth/MiniMax-H3-GGUF
Base model
MiniMaxAI/MiniMax-H3