Model: vito95311/Qwen3-Omni-30B-A3B-Thinking-GGUF-INT8FP16
Author: vito95311
Pipeline: text-generation
Library: llama.cpp
Tags: llama.cpp, gguf, pytorch, transformers, text-generation, multimodal, quantized, ollama, llama-cpp, qwen, omni, int8, fp16, zh, en, multilingual, base_model:Qwen/Qwen3-Omni-30B-A3B-Thinking, base_model:quantized:Qwen/Qwen3-Omni-30B-A3B-Thinking, license:apache-2.0, model-index, endpoints_compatible, region:us
Base models (quantized): id: Qwen/Qwen3-Omni-30B-A3B-Thinking
Card metadata: language: zh, en, multilingual
tags: pytorch, transformers, text-generation, multimodal, quantized, gguf, ollama, llama-cpp, qwen, omni, int8, fp16
pipeline_tag: text-generation
license: apache-2.0
model-index: name: Qwen3-Omni-30B-A3B-Thinking-GGUF-INT8FP16
results: task: type: text-generation
name: Text Generation
metrics: type: tokens_per_second
value: 25.3
verified: no
library_name: llama.cpp
base_model: Qwen/Qwen3-Omni-30B-A3B-Thinking
Likes: 15 | All-time downloads: 17306
Created: 2025-09-24 11:31:52