Hugging Face model: rpp01/tokensurgeon-Qwen2.5-7B-Instruct-Meta-Llama-3.1-8B-Instruct-knn-euc-k8-Q4_K_M-GGUF
Author: rpp01
Created: 2025-12-02 14:09:05
Last modified: 2025-12-02 14:09:27
Likes: 0 | Downloads: 103
Tags: gguf, llama-cpp, gguf-my-repo, base_model:gsaltintas/tokensurgeon-Qwen2.5-7B-Instruct-Meta-Llama-3.1-8B-Instruct-knn-euc-k8, base_model:quantized:gsaltintas/tokensurgeon-Qwen2.5-7B-Instruct-Meta-Llama-3.1-8B-Instruct-knn-euc-k8, endpoints_compatible, region:us, conversational
Base model relation: quantized
Base models: id: gsaltintas/tokensurgeon-Qwen2.5-7B-Instruct-Meta-Llama-3.1-8B-Instruct-knn-euc-k8
Card metadata:
base_model: gsaltintas/tokensurgeon-Qwen2.5-7B-Instruct-Meta-Llama-3.1-8B-Instruct-knn-euc-k8
tags: llama-cpp, gguf-my-repo