Michael Goin PRO

mgoin's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cognitivecomputations/DeepSeek-R1-AWQ 4 days ago

when i use vllm v0.7.2 to deploy r1 awq, i got empty content

5

#10 opened 4 days ago by

bupalinyu

MLA is not supported with moe_wna16 quantization. Disabling MLA.

5

#7 opened 5 days ago by

AMOSE

updated a model 4 days ago

nm-testing/DeepSeek-Coder-V2-Lite-Instruct-FP8

Text Generation • Updated 4 days ago • 19

upvoted a paper 7 days ago

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations

Paper • 2502.05003 • Published 10 days ago • 40

updated 3 models 10 days ago

nm-testing/pixtral-12b-FP8-dynamic-all

Updated 10 days ago • 29

neuralmagic/pixtral-12b-FP8-dynamic

Text Generation • Updated 10 days ago • 8.24k • 7

mgoin/pixtral-12b

Image-Text-to-Text • Updated 10 days ago • 515 • 1

published a model 10 days ago

nm-testing/Pixtral-Large-Instruct-2411-hf-FP8-dynamic

Image-Text-to-Text • Updated 10 days ago • 65

updated 2 models 10 days ago

nm-testing/Pixtral-Large-Instruct-2411-hf-FP8-dynamic

Image-Text-to-Text • Updated 10 days ago • 65

nm-testing/Pixtral-Large-Instruct-2411-hf

Image-Text-to-Text • Updated 10 days ago • 188

updated a model 11 days ago

nm-testing/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Updated 11 days ago • 264

published a model 11 days ago

nm-testing/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Updated 11 days ago • 264

updated a model 11 days ago

nm-testing/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Updated 11 days ago • 281

published a model 11 days ago

nm-testing/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Updated 11 days ago • 281

updated a model 11 days ago

nm-testing/Qwen2.5-VL-3B-Instruct-FP8-Dynamic

Updated 11 days ago • 198

published a model 11 days ago

nm-testing/Qwen2.5-VL-3B-Instruct-FP8-Dynamic

Updated 11 days ago • 198

New activity in neuralmagic/gemma-2-9b-it-FP8 11 days ago

AttributeError: 'Gemma2Config' object has no attribute 'interleaved_sliding_window' Traceback (most recent call last):

2

#3 opened 13 days ago by

samos123

New activity in neuralmagic/granite-3.1-8b-instruct-FP8-dynamic 13 days ago

compressed-tensors MLA support requires fp8 activations and weights in group 'group_0',

2

#1 opened 13 days ago by

samos123

published 2 models 13 days ago

nm-testing/Yi-6B-Llama-50-quant-ds-768

Text Generation • Updated Nov 17, 2023 • 4

nm-testing/AmberChat-pruned60-quant-ds

Text Generation • Updated Dec 15, 2023 • 8