Hugging Face model: soyrsoyr/Llama-3.2-1B-Instruct-FP8-GPTQ
Author: soyrsoyr
Created: 2026-06-07 14:40:12
Last modified: 2026-06-07 15:28:43
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 8
Tags: transformers, safetensors, llama, text-generation, gptq, quantized, compressed-tensors, vllm, llm-compressor, fp8, conversational, base_model:meta-llama/Llama-3.2-1B-Instruct, base_model:quantized:meta-llama/Llama-3.2-1B-Instruct, license:llama3.2, text-generation-inference, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: meta-llama/Llama-3.2-1B-Instruct
Card metadata:
license: llama3.2
base_model: meta-llama/Llama-3.2-1B-Instruct
library_name: transformers
tags: llama, gptq, quantized, compressed-tensors, vllm, llm-compressor, fp8
pipeline_tag: text-generation