Hugging Face's logo
Robert Shaw's picture
13 6 5

Robert Shaw

robertgshaw2
shubhrapandit's profile picture brwillia's profile picture herMaster's profile picture
·

AI & ML interests

None yet

Recent Activity

upvoted a paper 22 days ago
"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
New activity about 1 month ago
neuralmagic/Meta-Llama-3-8B-Instruct-FP8:How to download the model with transformer library
New activity about 1 month ago
mistralai/Pixtral-12B-2409:Update README.md
View all activity

Organizations

HeavyAI's profile picture Neural Magic's profile picture Revel Labs's profile picture NM Testing's profile picture

robertgshaw2's activity

upvoted a paper 22 days ago
New activity in neuralmagic/Meta-Llama-3-8B-Instruct-FP8 about 1 month ago

How to download the model with transformer library

5
#6 opened about 1 month ago by Rick10
New activity in mistralai/Pixtral-12B-2409 about 1 month ago

Update README.md

3
#25 opened about 1 month ago by robertgshaw2
updated a model about 2 months ago
upvoted a collection about 2 months ago
New activity in neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8 about 2 months ago

Issue running on vLLM using FP8

2
#3 opened about 2 months ago by ffleandro
updated a model about 2 months ago
New activity in neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 3 months ago

vllm says the requested model does not exist

2
#1 opened 3 months ago by shivams101
New activity in neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 3 months ago

Storage format differs from other w4a16 models

2
#2 opened 3 months ago by timdettmers
New activity in neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 3 months ago

Model weights are not loaded

4
#3 opened 3 months ago by MarvelousMouse
updated 2 models 4 months ago
New activity in neuralmagic/Mistral-Nemo-Instruct-2407-FP8 4 months ago

Can not be inferenced with vllm openai server

1
#1 opened 4 months ago by jjqsdq
updated 3 models 4 months ago
updated a model 5 months ago
New activity in neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w4a16 5 months ago

Code example request with vllm

2
#1 opened 5 months ago by ShiningJazz
updated 2 models 5 months ago