Hugging Face model: JohnConnor123/RuadaptQwen2.5-14B-Instruct-1M-AWQ-64G-INT4-vGEMM
Author: JohnConnor123
Created: 2025-02-26 22:46:10
Last modified: 2025-02-26 23:07:11
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 9
Tags: transformers, safetensors, qwen2, text-generation, AWQ, conversational, arxiv:1910.09700, base_model:RefalMachine/RuadaptQwen2.5-14B-Instruct-1M, base_model:quantized:RefalMachine/RuadaptQwen2.5-14B-Instruct-1M, text-generation-inference, endpoints_compatible, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: RefalMachine/RuadaptQwen2.5-14B-Instruct-1M
Card metadata:
library_name: transformers
tags: AWQ
base_model: RefalMachine/RuadaptQwen2.5-14B-Instruct-1M