Hugging Face model: PrunaAI/nvidia-Llama3-ChatQA-1.5-8B-GGUF-smashed
Author: PrunaAI
Created: 2024-05-04 16:32:35
Last modified: 2026-03-25 16:47:24
Library: pruna-ai
Likes: 0 | Downloads: 828
Tags: pruna-ai, gguf, base_model:nvidia/Llama3-ChatQA-1.5-8B, base_model:quantized:nvidia/Llama3-ChatQA-1.5-8B, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: nvidia/Llama3-ChatQA-1.5-8B
Card metadata:
base_model: nvidia/Llama3-ChatQA-1.5-8B
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai