OpenSourceRonin PRO

OpenSourceRonin's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in deepseek-ai/DeepSeek-V3-0324 24 days ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

10

#19 opened 24 days ago by

xueshuai

updated 19 models 29 days ago

VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-256-woft

Updated 29 days ago • 15

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft

Updated 29 days ago • 30

VPTQ-community/Meta-Llama-3-70B-v16-k65536-65536-woft

Updated 29 days ago • 7

VPTQ-community/Meta-Llama-3-70B-v12-k4096-4096-woft

Updated 29 days ago • 7

VPTQ-community/Meta-Llama-3-70B-v12-k4096-4096-ft

Updated 29 days ago • 8

VPTQ-community/Meta-Llama-3-8B-v12-k4096-4096-woft

Updated 29 days ago • 11

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-256-woft

Updated 29 days ago • 12

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-65536-woft

Updated 29 days ago • 9

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft

Updated 29 days ago • 16

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-65536-woft

Updated 29 days ago • 13

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-0-woft

Updated 29 days ago • 9

VPTQ-community/Qwen2.5-14B-Instruct-v16-k65536-65536-woft

Updated 29 days ago • 8

VPTQ-community/Meta-Llama-3-8B-v6-k4096-4096-woft

Updated 29 days ago • 9

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-256-woft

Updated 29 days ago • 46

VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft

Updated 29 days ago • 9

VPTQ-community/Qwen2.5-14B-Instruct-v8-k256-256-woft

Updated 29 days ago • 8

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft

Updated 29 days ago • 25

VPTQ-community/Meta-Llama-3-8B-v4-k4096-0-woft

Updated 29 days ago • 11

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft

Updated 29 days ago • 7