Hugging Face model: djuna/Q2.5-Veltha-14B-0.5-AWQ-4bit
Author: djuna
Created: 2025-01-19 00:21:12
Last modified: 2025-01-19 00:24:46
Library: pruna-ai
Likes: 0 | Downloads: 14
Tags: pruna-ai, safetensors, qwen2, base_model:djuna/Q2.5-Veltha-14B-0.5, base_model:quantized:djuna/Q2.5-Veltha-14B-0.5, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: djuna/Q2.5-Veltha-14B-0.5
Card metadata:
base_model: djuna/Q2.5-Veltha-14B-0.5
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai