numen-tech's picture
Add weights
05ec6a7
metadata
language:
  - en
  - de
  - fr
  - it
  - pt
  - hi
  - es
  - th
license: llama3.2
base_model: FuseAI/FuseChat-Llama-3.2-3B-Instruct
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

4-bit OmniQuant quantized version of FuseChat-Llama-3.2-3B-Instruct for inference with Private LLM.