Model: smkrv/Qwen3-0.6B-CoreML-4bit
Author: smkrv
Pipeline: text-generation
Library: coreml
Tags: coreml, apple-silicon, neural-engine, ane, llm, quantized, 4bit, mobile, ios, macos, qwen3, text-generation, en, zh, multilingual, ru, base_model:Qwen/Qwen3-0.6B, base_model:quantized:Qwen/Qwen3-0.6B, license:apache-2.0, model-index, region:us
Base models (quantized): id: Qwen/Qwen3-0.6B
Card metadata: library_name: coreml
pipeline_tag: text-generation
license: apache-2.0
language: en, zh, multilingual, ru
tags: coreml, apple-silicon, neural-engine, ane, llm, quantized, 4bit, mobile, ios, macos, qwen3
base_model: Qwen/Qwen3-0.6B
model-index: name: Qwen3-0.6B-CoreML-4bit
results: task: type: text-generation
dataset: name: Custom Benchmark (M4 MacBook Air)
type: custom
metrics: name: Tokens per second
type: throughput
value: 13
verified: no, name: Prefill Latency (ms)
type: latency
value: 27
verified: no, name: Decode Latency (ms)
type: latency
value: 9
verified: no, name: Memory Peak (MB)
type: memory
value: 820
verified: no
source: name: Internal Benchmark
url: https://huggingface.co/smkrv
Likes: 0 | All-time downloads: 35
Created: 2025-12-03 00:15:10