| language: | |
| - en | |
| - de | |
| - fr | |
| - it | |
| - pt | |
| - hi | |
| - es | |
| - th | |
| license: llama3.2 | |
| base_model: FuseAI/FuseChat-Llama-3.2-3B-Instruct | |
| base_model_relation: quantized | |
| library_name: mlc-llm | |
| pipeline_tag: text-generation | |
| 4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [FuseChat-Llama-3.2-3B-Instruct](https://huggingface.co/FuseAI/FuseChat-Llama-3.2-3B-Instruct) for inference with [Private LLM](http://privatellm.app). | |