Hugging Face model: EliasOenal/Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic
Author: EliasOenal
Created: 2025-02-12 10:57:41
Last modified: 2025-02-12 13:17:47
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 9
Tags: transformers, safetensors, llama, text-generation, nvidia, nemotron, w8a8, vllm, conversational, en, dataset:neuralmagic/LLM_compression_calibration, base_model:nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, base_model:quantized:nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, license:llama3.1, text-generation-inference, endpoints_compatible, 8-bit, compressed-tensors, region:us
Base model relation: quantized
Base models: id: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Card metadata:
license: llama3.1
language: en
tags: llama, nvidia, nemotron, w8a8, vllm
base_model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
library_name: transformers
datasets: neuralmagic/LLM_compression_calibration