Hugging Face model: BlivionIaG/Qwen3.5-0.8B-AWQ-INT4
Author: BlivionIaG
Created: 2026-05-06 23:07:32
Last modified: 2026-05-07 03:57:01
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 740
Tags: transformers, safetensors, qwen3_5_text, text-generation, compressed-tensors, awq, 4-bit, llm-compressor, int4, quantized, en, base_model:Qwen/Qwen3.5-0.8B, base_model:quantized:Qwen/Qwen3.5-0.8B, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3.5-0.8B
Card metadata:
base_model: Qwen/Qwen3.5-0.8B
base_model_relation: quantized
pipeline_tag: text-generation
library_name: transformers
license: apache-2.0
language: en
tags: compressed-tensors, awq, 4-bit, llm-compressor, int4, quantized
inference: parameters: temperature: 1
top_p: 0.95
top_k: 20
presence_penalty: 1.5
max_new_tokens: 2048