Michael Goin

mgoin's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mistralai/Mistral-Small-3.1-24B-Instruct-2503 1 day ago

FP8 Dynamic/W8A16 Quants Please

1

#44 opened 9 days ago by

rjmehta

Problem hosting the model using vllm

4

#45 opened 8 days ago by

ShaoServient

updated a model 9 days ago

nm-testing/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

Updated 9 days ago • 882 • 1

published a model 9 days ago

nm-testing/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

Updated 9 days ago • 882 • 1

New activity in neuralmagic/Qwen2.5-VL-72B-Instruct-quantized.w8a8 about 1 month ago

Remove image_processor_type

#1 opened about 1 month ago by

pooya-davoodi-parasail

updated 2 models about 1 month ago

nm-testing/QwQ-32B-FP8-dynamic

Text Generation • Updated 30 days ago • 4.35k • 3

nm-testing/Ministral-8B-Instruct-2410-FP8-dynamic

Updated about 1 month ago • 30

published a model about 1 month ago

nm-testing/QwQ-32B-FP8-dynamic

Text Generation • Updated 30 days ago • 4.35k • 3

New activity in neuralmagic/Qwen2.5-VL-7B-Instruct-quantized.w8a8 about 1 month ago

Remove image_processor_type

1

#1 opened about 1 month ago by

pooya-davoodi-parasail

updated a model about 1 month ago

mgoin/Qwen1.5-14B-Chat-GPTQ

Text Generation • Updated about 1 month ago • 7

published 2 models about 1 month ago

mgoin/Qwen1.5-14B-Chat-GPTQ

Text Generation • Updated about 1 month ago • 7

nm-testing/Ministral-8B-Instruct-2410-FP8-dynamic

Updated about 1 month ago • 30

New activity in neuralmagic/Qwen2.5-VL-72B-Instruct-FP8-Dynamic about 1 month ago

Remove image_processor_type

#2 opened about 1 month ago by

pooya-davoodi-parasail

updated a model about 1 month ago

nm-testing/Qwen1.5-MoE-A2.7B-Chat-quantized.w4a16

Updated Feb 24 • 91

New activity in neuralmagic/Qwen2.5-VL-7B-Instruct-FP8-Dynamic about 1 month ago

Use Qwen2VLImageProcessor for image_processor_type

5

#2 opened about 1 month ago by

pooya-davoodi-parasail

Use Qwen2VLImageProcessor for image_processor_type

#3 opened about 1 month ago by

pooya-davoodi-parasail

published a model about 1 month ago

nm-testing/Qwen1.5-MoE-A2.7B-Chat-quantized.w4a16

Updated Feb 24 • 91

updated a collection about 1 month ago

Vision Language Models Quantization

Collection

Vision Language Models (VLMs) quantized by Neural Magic • 20 items • Updated Mar 4 • 5

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 2 months ago

when i use vllm v0.7.2 to deploy r1 awq, i got empty content

13

#10 opened about 2 months ago by

bupalinyu

MLA is not supported with moe_wna16 quantization. Disabling MLA.

5

#7 opened about 2 months ago by

AMOSE