Edit Models filters

Inference status

Misc

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

297

Full-text search

Active filters: web-llm

mlc-ai/Llama-3.2-1B-Instruct-q4f16_0-MLC

Updated Sep 26 • 347 • 2

mlc-ai/Llama-2-70b-chat-hf-q4f16_1-MLC

Updated Jul 11 • 8 • 2

mlc-ai/gemma-2b-it-q4f16_1-MLC

Updated Aug 1 • 731 • 5

mlc-ai/Llama-3-8B-Instruct-q4f32_1-MLC

Updated Sep 19 • 816 • 1

mlc-ai/Llama-3-8B-Instruct-q4f16_1-MLC

Updated Sep 19 • 872 • 3

mlc-ai/SmolLM-135M-Instruct-q0f16-MLC

Updated Jul 16 • 157 • 1

mlc-ai/Llama-3.1-8B-Instruct-q4f16_1-MLC

Updated Sep 19 • 321 • 1

mlc-ai/gemma-2-2b-it-q4f16_1-MLC

Updated Aug 1 • 4.45k • 6

mlc-ai/gemma-2-9b-it-q3f16_1-MLC

Updated Aug 1 • 2 • 1

mlc-ai/Phi-3.5-mini-instruct-q4f16_1-MLC

Updated Aug 23 • 2.15k • 3

mlc-ai/Qwen2.5-3B-Instruct-q4f16_1-MLC

Updated Sep 19 • 137 • 1

mlc-ai/Qwen2.5-7B-Instruct-q4f16_1-MLC

Updated Sep 19 • 101 • 2

mlc-ai/Qwen2.5-Coder-1.5B-Instruct-q0f16-MLC

Updated Sep 19 • 4 • 1

mlc-ai/Qwen2.5-Coder-7B-Instruct-q4f16_1-MLC

Updated Sep 19 • 83 • 1

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25 • 902 • 2

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25 • 802 • 1

rohanprichard/Llama-3.2-1B-Instruct-MLC

Updated Sep 26 • 2 • 3

rohanprichard/Llama-3.1-SuperNova-Lite-MLC

Updated Sep 26 • 4 • 1

mlc-ai/Llama-2-7b-chat-hf-q4f16_1-MLC

Updated Jul 11 • 358 • 8

mlc-ai/Llama-2-7b-chat-hf-q4f32_1-MLC

Updated Jul 11 • 3.58k • 2

mlc-ai/Mistral-7B-Instruct-v0.2-q4f16_1-MLC

Updated Jul 11 • 665 • 4

mlc-ai/Llama-2-13b-chat-hf-q4f16_1-MLC

Updated Jul 11 • 65 • 1

mlc-ai/OpenHermes-2.5-Mistral-7B-q4f16_1-MLC

Updated Jul 11 • 48 • 1

mlc-ai/NeuralHermes-2.5-Mistral-7B-q4f16_1-MLC

Updated Jul 11 • 35 • 2

mlc-ai/WizardMath-7B-V1.0-q4f16_1-MLC

Updated Jul 11 • 4

mlc-ai/WizardMath-13B-V1.0-q4f16_1-MLC

Updated Jul 11 • 3

mlc-ai/WizardMath-70B-V1.0-q4f16_1-MLC

Updated Jul 11 • 2

mlc-ai/RedPajama-INCITE-Chat-3B-v1-q4f16_1-MLC

Updated Jul 11 • 264 • 2

mlc-ai/RedPajama-INCITE-Chat-3B-v1-q4f32_1-MLC

Updated Jul 11 • 68 • 2

mlc-ai/WizardMath-7B-V1.1-q4f16_1-MLC

Updated Jul 11 • 54