Hugging Face model: tensorblock/OpenHermes-2.5-Mistral-7B-pruned2.4-GGUF
Author: tensorblock
Created: 2024-12-24 23:36:41
Last modified: 2026-01-27 21:14:03
Likes: 0 | Downloads: 63
Tags: gguf, nm-vllm, sparse, TensorBlock, GGUF, base_model:RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4, base_model:quantized:RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4
Card metadata:
base_model: neuralmagic/OpenHermes-2.5-Mistral-7B-pruned2.4
inference: yes
model_type: mistral
quantized_by: mgoin
tags: nm-vllm, sparse, TensorBlock, GGUF