Hugging Face model: yw223/Meta-Llama-3.1-8B-Instruct-OmniQuant-4bit
Author: yw223
Created: 2026-06-24 21:55:07
Last modified: 2026-06-24 22:13:41
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 9
Tags: transformers, safetensors, llama, text-generation, omniquant, quantization, weight-only-quantization, fake-quantized, conversational, dataset:Salesforce/wikitext, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:finetune:meta-llama/Llama-3.1-8B-Instruct, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: meta-llama/Llama-3.1-8B-Instruct
Card metadata:
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
library_name: transformers
pipeline_tag: text-generation
tags: omniquant, quantization, weight-only-quantization, fake-quantized
datasets: Salesforce/wikitext