Hugging Face model: mysticbeing/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-DYNAMIC
Author: mysticbeing
Created: 2024-10-31 23:24:50
Last modified: 2024-11-06 21:32:26
Pipeline: text-generation
Likes: 3 | Downloads: 9
Tags: safetensors, llama, fp8, vllm, text-generation, conversational, en, de, fr, it, pt, hi, es, th, arxiv:2410.01257, arxiv:2208.09225, arxiv:2405.01481, arxiv:2406.08673, base_model:nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, base_model:finetune:nvidia/Llama-3.1-Nemotron-70B-Instruct-HF, license:llama3.1, region:us
Base model relation: finetune
Base models: id: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Card metadata:
tags: fp8, vllm
language: en, de, fr, it, pt, hi, es, th
pipeline_tag: text-generation
license: llama3.1
base_model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF