How to use huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated") model = AutoModelForMultimodalLM.from_pretrained("huihui-ai/Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated", device_map="auto")
Handyfff