Tiny Models - a inference-optimization Collection

inference-optimization 's Collections

Tiny Models

updated 3 days ago

Tiny models used for testing

inference-optimization/gemma-4-1B-0.8B-tiny

1B • Updated 3 days ago • 339 • 2
inference-optimization/DSV4-tiny-empty

3B • Updated 3 days ago • 5.32k • 1
inference-optimization/Qwen3-1.6B-A0.9B

Text Generation • 2B • Updated May 24 • 15.3k • 3
inference-optimization/Llama-3.2-0.5B-Instruct

Text Generation • 0.5B • Updated Jun 3 • 24.6k • 1
inference-optimization/GLM-5.2-0.8B-A0.8B

Text Generation • 0.8B • Updated Jul 2 • 5.34k • 4
inference-optimization/Phi-3.5-MoE-0.8B-A0.2B

Text Generation • 0.8B • Updated Jun 22 • 135
inference-optimization/Llama-4-Scout-1.7B-0.4B-Instruct

Image-Text-to-Text • 2B • Updated Jun 4 • 152
inference-optimization/gpt-oss-2.5B-A1.3B

3B • Updated Jun 4 • 139
inference-optimization/Qwen3-VL-1.0B-A0.4B-Instruct

Image-Text-to-Text • 1B • Updated Jul 17 • 145 • 1
inference-optimization/Inkling-0.6B-A0.6B

Image-Text-to-Text • 0.6B • Updated Jul 20 • 219 • 1
inference-optimization/DeepSeek-V4-Pro-0.5B-A0.37B

Text Generation • 0.5B • Updated Jul 22 • 238
inference-optimization/Kimi-K3-0.40B

Feature Extraction • 0.4B • Updated Jul 28 • 9.65k • 82
inference-optimization/Kimi-K3-0.40B-MXFP4

0.4B • Updated 8 days ago • 2.59k • 7
inference-optimization/Kimi-K3-0.40B-NVFP4

0.4B • Updated Jul 29 • 107 • 5
inference-optimization/gemma-4-unified-0.8B-tiny

0.8B • Updated Aug 12 • 138
inference-optimization/granite-vision-4.1-0.2B-tiny

0.2B • Updated Aug 12 • 131
inference-optimization/Qwen3-VL-Reranker-0.1B-tiny

98.7M • Updated Aug 12 • 271
inference-optimization/Qwen3.8-1.0B-A0.6B

Text Generation • 1.0B • Updated Aug 12 • 4.26k • 4
inference-optimization/GLM-5.3-Flash-0.1B-A0.1B

Image-Text-to-Text • 84.4M • Updated 17 days ago • 1.03k • 3
inference-optimization/Qwen3.8-Flash-Next-0.2B-A0.2B

Image-Text-to-Text • 0.2B • Updated 3 days ago • 758 • 2
inference-optimization/Nemotron-3.5-Lightning-1.4B-A0.1B-MTP

Text Generation • 1B • Updated 17 days ago • 683 • 1
inference-optimization/Qwen3.6-8B-A1.6B

Image-Text-to-Text • 8B • Updated 8 days ago • 417
inference-optimization/NemotronH-0.3B-A0.3B

Text Generation • 0.3B • Updated 3 days ago • 1.05k • 1
inference-optimization/GLM-5.3-0.6B-A0.4B

Text Generation • 0.6B • Updated 3 days ago • 215