Hugging Face model: mgoin/Minitron-8B-Base-FP8
Author: mgoin
Created: 2024-07-23 15:20:00
Last modified: 2024-07-26 18:54:26
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 10
Tags: transformers, safetensors, nemotron, text-generation, fp8, vllm, arxiv:2407.14679, base_model:nvidia/Minitron-8B-Base, base_model:quantized:nvidia/Minitron-8B-Base, license:other, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: nvidia/Minitron-8B-Base
Card metadata:
license: other
license_name: nvidia-open-model-license
license_link: https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf
tags: fp8, vllm
base_model: nvidia/Minitron-8B-Base