Edit Models filters

Inference status

Misc

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

298

Full-text search

Active filters: web-llm

mlc-ai/CodeLlama-34b-Python-hf-q4f32_1-MLC

Updated Jul 11 • 3

mlc-ai/CodeLlama-70b-hf-q3f16_1-MLC

Updated Jul 11 • 9

mlc-ai/CodeLlama-70b-hf-q4f16_1-MLC

mlc-ai/CodeLlama-70b-hf-q4f32_1-MLC

Updated Jul 11 • 10

mlc-ai/CodeLlama-70b-Instruct-hf-q3f16_1-MLC

Updated Jul 11 • 2

mlc-ai/CodeLlama-70b-Instruct-hf-q4f16_1-MLC

Updated Jul 11 • 2

mlc-ai/CodeLlama-70b-Instruct-hf-q4f32_1-MLC

mlc-ai/CodeLlama-70b-Python-hf-q4f32_1-MLC

Updated Jul 11 • 2 • 1

mlc-ai/CodeLlama-70b-Python-hf-q3f16_1-MLC

Updated Jul 11 • 4 • 1

mlc-ai/CodeLlama-70b-Python-hf-q4f16_1-MLC

Updated Jul 11 • 5 • 1

mlc-ai/stablelm-2-zephyr-1_6b-q0f16_1-MLC

mlc-ai/stablelm-zephyr-3b-q0f16-MLC

mlc-ai/stablelm-zephyr-3b-q0f32-MLC

Updated Jul 11 • 5

mlc-ai/stablelm-zephyr-3b-q4f16_1-MLC

Updated Jul 11 • 3

mlc-ai/stablelm-zephyr-3b-q4f32_1-MLC

Updated Jul 11 • 3 • 1

mlc-ai/gemma-2b-it-q4f16_1-MLC

Updated Aug 1 • 728 • 5

mlc-ai/gemma-2b-it-q4f32_1-MLC

Updated Aug 1 • 72 • 2

mlc-ai/gemma-2b-it-q0f16-MLC

mlc-ai/gemma-2b-it-q0f32-MLC

Updated Aug 1 • 1

mlc-ai/gemma-7b-it-q0f16-MLC

Updated Aug 1 • 5

mlc-ai/gemma-7b-it-q4f16_2-MLC

Updated Jul 11 • 17 • 1

mlc-ai/gorilla-openfunctions-v1-q4f16_1-MLC

Updated Jul 11 • 2

mlc-ai/gorilla-openfunctions-v2-q4f16_1-MLC

Updated Jul 11 • 2

mlc-ai/gorilla-openfunctions-v2-q4f32_1-MLC

Updated Jul 11 • 6

mlc-ai/gemma-2b-it-q4f16_0-MLC

Updated Aug 1 • 8

mlc-ai/Qwen1.5-MoE-A2.7B-Chat-q4f16_1-MLC

Updated Jul 11 • 2 • 3

mlc-ai/Llama-3-8B-Instruct-q0f32-MLC

Updated Jul 11 • 2

mlc-ai/Llama-3-70B-Instruct-q3f16_1-MLC

Updated Jul 11 • 109 • 1

mlc-ai/Llama-3-8B-Instruct-q3f16_2-MLC

Updated Jul 11 • 3 • 2

mlc-ai/Hermes-2-Pro-Mistral-7B-q4f16_1-MLC

Updated Aug 5 • 623 • 1