meta-llama/Meta-Llama-3.1-8B-Instruct
Text Generation
•
Updated
•
2.98M
•
•
2.24k
NIM Serverless Inference API
Models in this collection are available for inference via a serverless API powered by NVIDIA NIM.
Note NIM LLM deployed with H100 x 1
meta-llama/Meta-Llama-3.1-70B-Instruct
Text Generation • Updated • 797k • • 434Note NIM LLM deployed with H100 x 4
meta-llama/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation • Updated • 59.8k • 156Note NIM LLM deployed with H100 x 8
meta-llama/Meta-Llama-3-8B-Instruct
Text Generation • Updated • 1.89M • • 3.37kNote NIM LLM deployed with H100 x 1
meta-llama/Meta-Llama-3-70B-Instruct
Text Generation • Updated • 184k • • 1.37kNote NIM LLM deployed with H100 x 4
mistralai/Mistral-7B-Instruct-v0.3
Text Generation • Updated • 658k • • 938Note NIM LLM deployed with H100 x 2
mistralai/Mixtral-8x7B-Instruct-v0.1
Text Generation • Updated • 370k • • 4.09kNote NIM LLM deployed with H100 x 2
mistralai/Mixtral-8x22B-Instruct-v0.1
Text Generation • Updated • 27k • 656Note NIM LLM deployed with H100 x 8