Article
Making LLMs lighter with AutoGPTQ and transformers
•
37
Jack Ji
qwertyjack
AI & ML interests
None yet
Recent Activity
updated
a model
12 days ago
ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v1
new activity
12 days ago
ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v1:Sync with Qwen/QwQ-32B-Preview
new activity
27 days ago
TechxGenus/Mistral-Large-Instruct-2411-GPTQ:感觉新版的Mistrial-LargeV3的GPTQ量化的int4版本对显存的需求大大提升了
Organizations
qwertyjack's activity
upvoted
an
article
3 months ago
upvoted
an
article
4 months ago
Article
TGI Multi-LoRA: Deploy Once, Serve 30 Models
•
53