Model: suraiy/microsoft-Phi-3-mini-128k-instruct-HQQ-4bit-smashed-Q4_K_M-GGUF
Author: suraiy
Library: pruna-ai
Tags: pruna-ai, gguf, llama-cpp, gguf-my-repo, base_model:microsoft/Phi-3-mini-128k-instruct, base_model:quantized:microsoft/Phi-3-mini-128k-instruct, endpoints_compatible, region:us, conversational
Base models (quantized): id: microsoft/Phi-3-mini-128k-instruct
Card metadata: tags: pruna-ai, llama-cpp, gguf-my-repo
base_model: microsoft/Phi-3-mini-128k-instruct
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
thumbnail: https://assets-global.website-files.com/646b351987a8d8ce158d1940/64ec9e96b4334c0e1ac41504_Logo%20with%20white%20text.svg
Likes: 0 | All-time downloads: 293
Created: 2024-05-29 02:52:02