Hugging Face model: Farikhan/Llama-3.1-8B-Instruct-GPTQ-4bit
Author: Farikhan
Created: 2026-04-28 15:20:19
Last modified: 2026-04-29 18:25:02
Pipeline: text-generation
Likes: 0 | Downloads: 7
Tags: safetensors, llama, quantization, 4-bit, gptq, vllm, text-generation, llmcompressor, conversational, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:quantized:meta-llama/Llama-3.1-8B-Instruct, compressed-tensors, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-3.1-8B-Instruct
Card metadata:
base_model: meta-llama/Llama-3.1-8B-Instruct
tags: quantization, 4-bit, gptq, vllm, text-generation, llmcompressor
inference: no