Model: EliasOenal/Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic
Author: EliasOenal
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, nvidia, nemotron, w8a8, vllm, conversational, en, dataset:neuralmagic/LLM_compression_calibration, base_model:nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, base_model:quantized:nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, license:llama3.1, text-generation-inference, endpoints_compatible, 8-bit, compressed-tensors, region:us
Base models (quantized): id: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Card metadata: license: llama3.1
language: en
tags: llama, nvidia, nemotron, w8a8, vllm
base_model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
library_name: transformers
datasets: neuralmagic/LLM_compression_calibration
Likes: 0 | All-time downloads: 85
Created: 2025-02-12 10:57:41