PrunaAI
/

microsoft-Phi-3-mini-128k-instruct-HQQ-1bit-smashed

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (2)

Error loading model with HQQModelForCausalLM: Model architecture Phi3ForCausalLM not supported yet.

#3 opened 7 months ago by

Windows not supported for torch.compile

#2 opened 7 months ago by