Hugging Face model: PrunaAI/dolphin-2.9-llama3-70b-GGUF-smashed
Author: PrunaAI
Created: 2024-04-26 02:25:36
Last modified: 2026-03-25 16:47:03
Library: pruna-ai
Likes: 3 | Downloads: 642
Tags: pruna-ai, gguf, base_model:dphn/dolphin-2.9-llama3-70b, base_model:quantized:dphn/dolphin-2.9-llama3-70b, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: dphn/dolphin-2.9-llama3-70b
Card metadata:
base_model: cognitivecomputations/dolphin-2.9-llama3-70b
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai