Hugging Face model: PrunaAI/AIFunOver-Qwen2.5-7B-Instruct-1M-openvino-fp16-GGUF-smashed
Author: PrunaAI
Created: 2025-01-28 08:42:32
Last modified: 2026-03-25 16:48:01
Library: pruna-ai
Likes: 0 | Downloads: 129
Tags: pruna-ai, gguf, base_model:AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-fp16, base_model:quantized:AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-fp16, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-fp16
Card metadata:
base_model: AIFunOver/Qwen2.5-7B-Instruct-1M-openvino-fp16
metrics: memory_disk, memory_inference, inference_latency, inference_throughput, inference_CO2_emissions, inference_energy_consumption
tags: pruna-ai