This is a MLC converted weight from DeepHermes-3-Llama-3-8B-Preview model in MLC format q4f16_1.

The model can be used for projects MLC-LLM and WebLLM.

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The HF Inference API does not support text-generation models for mlc-llm library.

Model tree for huggingkot/DeepHermes-3-Llama-3-8B-Preview-q4f16_1-MLC

Base model

Finetuned

Quantized

(33)

this model

Collection including huggingkot/DeepHermes-3-Llama-3-8B-Preview-q4f16_1-MLC