Instructions to use EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2 with Transformers:
# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
How to get it to work? Any directions appreciated!
I would really like some pointers, I can't get it to work no matter what I try. I currently use transformers 5.2 which at least takes me through 5 minutes of "loading weights". But I keep getting different error messages. Currently, I get AttributeError: 'HunyuanImage3ForCausalMM' object has no attribute '_tkwrapper'.
Grok, the poor AI, has tried to help me the last 4 hours but I can't get image generation to work. What am I missing here? I have tried the distil v2 NF4, instructNF4 v2, and the older NF4 (version 1 I assume).
Are you using my comfyui custom nodes or another script? The error sounds like a transformers version miss match error but I don't know for sure.