Hugging Face model: joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4
Author: joshmiller656
Created: 2024-10-29 18:49:55
Last modified: 2024-11-05 23:42:52
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 11
Tags: transformers, safetensors, llama, text-generation, nemotron, awq, quantized, int4, conversational, en, de, fr, it, pt, hi, es, th, dataset:nvidia/HelpSteer2, arxiv:2410.01257, arxiv:2405.01481, arxiv:2406.08673, base_model:nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, base_model:quantized:nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, license:llama3.1, text-generation-inference, endpoints_compatible, 4-bit, region:us, deploy:azure
Base model relation: quantized
Base models: id: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Card metadata:
license: llama3.1
base_model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
language: en, de, fr, it, pt, hi, es, th
library_name: transformers
pipeline_tag: text-generation
datasets: nvidia/HelpSteer2
tags: llama, nemotron, awq, quantized, int4