Hugging Face model: alejandrovil/Meta-Llama-3-8B-Instruct-AWQ-4bit-smashed-tht
Author: alejandrovil
Created: 2024-09-12 03:36:47
Last modified: 2024-09-12 03:38:32
Library: pruna-ai
Likes: 0 | Downloads: 6
Tags: pruna-ai, safetensors, llama, base_model:meta-llama/Meta-Llama-3-8B-Instruct, base_model:quantized:meta-llama/Meta-Llama-3-8B-Instruct, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: meta-llama/Meta-Llama-3-8B-Instruct
Card metadata:
base_model: meta-llama/Meta-Llama-3-8B-Instruct
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai