Hugging Face model: PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed
Author: PrunaAI
Created: 2024-04-23 23:31:13
Last modified: 2026-03-25 16:38:34
Library: pruna-ai
Likes: 68 | Downloads: 6253
Tags: pruna-ai, gguf, endpoints_compatible, region:us, conversational
Card metadata:
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai