MH-Q36-27B-v3
Gated checkpoint — access by request.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("Zaynoid/MH-Q36-27B-v3")
model = AutoModelForCausalLM.from_pretrained("Zaynoid/MH-Q36-27B-v3", torch_dtype="bfloat16", device_map="auto")