Nick Brooks's picture

9 1 6

Nick Brooks

nickandbro

·

AI & ML interests

None yet

Recent Activity

new activity 1 day ago

nm-testing/pixtral-12b-w4a16-actorder-group:What is an actorder group and what are the advantages of running this in vLLM?

new activity 16 days ago

google/Gemma-Embeddings-v1.0:Compatible with vLLM?

liked a model 25 days ago

nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic

View all activity

Organizations

nickandbro's activity

New activity in nm-testing/pixtral-12b-w4a16-actorder-group 1 day ago

What is an actorder group and what are the advantages of running this in vLLM?

#1 opened 1 day ago by

New activity in google/Gemma-Embeddings-v1.0 16 days ago

Compatible with vLLM?

#4 opened 16 days ago by

New activity in HuggingFaceTB/SmolVLM-Instruct about 1 month ago

Will this work with vLLM?

#10 opened about 1 month ago by

New activity in neuralmagic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic 2 months ago

Can you please add Nemotron 70B static?

#1 opened 2 months ago by

New activity in nvidia/Llama-3.1-Nemotron-70B-Instruct-HF 3 months ago

Congrats to the Nvidia team!

#10 opened 3 months ago by

New activity in nvidia/Llama-3_1-Nemotron-51B-Instruct 3 months ago

vLLM compatible?

#10 opened 3 months ago by

New activity in nvidia/NV-Embed-v2 4 months ago

Does this work with vLLM?

#9 opened 4 months ago by

New activity in neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8 5 months ago

Is this compatible with the KV_Cache_dtype being FP8?

#1 opened 5 months ago by

New activity in jbilcke-hf/ai-comic-factory 6 months ago

Where can I find the code?

#832 opened 6 months ago by

Where can I find the code?

#832 opened 6 months ago by