Hugging Face model: JongYeop/Llama-3.1-8B-Instruct-INT8-W8A8-Dynamic-Per-Token
Author: JongYeop
Created: 2026-02-03 06:42:18
Last modified: 2026-02-03 06:43:27
Likes: 0 | Downloads: 29
Tags: safetensors, llama, llama-3, llama-3.1, instruct, int8, quantized, vllm, llm-compressor, w8a8, per-token, per-channel, dynamic-quantization, en, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:quantized:meta-llama/Llama-3.1-8B-Instruct, license:llama3.1, 8-bit, compressed-tensors, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-3.1-8B-Instruct
Card metadata:
language: en
license: llama3.1
tags: llama, llama-3, llama-3.1, instruct, int8, quantized, vllm, llm-compressor, w8a8, per-token, per-channel, dynamic-quantization
base_model: meta-llama/Llama-3.1-8B-Instruct