Hugging Face's logo

Zaynoid
/
RS-Q35-9B-v2-AWQ

Text Generation
Safetensors
English
qwen3_5
medical
conversational
compressed-tensors
Model card Files
xet
 Community

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

RS-Q35-9B-v2-AWQ

Gated checkpoint — access by request.

Usage 

from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("Zaynoid/RS-Q35-9B-v2-AWQ")
model = AutoModelForCausalLM.from_pretrained("Zaynoid/RS-Q35-9B-v2-AWQ", torch_dtype="bfloat16", device_map="auto")
Downloads last month
-
Safetensors
Model size
9B params
Tensor type
I64
·
I32
·
BF16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collections including Zaynoid/RS-Q35-9B-v2-AWQ