Nemotron in vLLM
Collection
Nemotron models that have been converted and/or quantized to work well in vLLM
•
7 items
•
Updated
Minitron-4B-Base-FP8
FP8 quantized checkpoint of nvidia/Minitron-4B-Base for use with vLLM.
- Downloads last month
- 3
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.