Hugging Face model: JongYeop/Llama-3.1-8B-Instruct-FP8-W8A8-Dynamic-Per-Token
Author: JongYeop
Created: 2026-02-03 07:10:32
Last modified: 2026-02-03 07:11:02
Likes: 0 | Downloads: 10
Tags: safetensors, llama, llama-3, llama-3.1, instruct, fp8, quantized, vllm, llm-compressor, w8a8, per-token, per-channel, dynamic-quantization, en, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:quantized:meta-llama/Llama-3.1-8B-Instruct, license:llama3.1, compressed-tensors, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-3.1-8B-Instruct
Card metadata:
language: en
license: llama3.1
tags: llama, llama-3, llama-3.1, instruct, fp8, quantized, vllm, llm-compressor, w8a8, per-token, per-channel, dynamic-quantization
base_model: meta-llama/Llama-3.1-8B-Instruct