Edit model card

llama-3.2-1b-instruct-ov

llama-3.2-1b-instruct-ov is an OpenVino int4 quantized version of Llama 3.2 1B Instruct, providing a very small, very fast inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

llama-3.2-1b-instruct is a new 1B chat foundation model from Meta.

Model Description

  • Developed by: meta-llama
  • Quantized by: llmware
  • Model type: llama-3.2
  • Parameters: 1 billion
  • Model Parent: meta-llama/Meta-Llama-3.2-1B-Instruct
  • Language(s) (NLP): English
  • License: Llama 3.2 Community License
  • Uses: General chat use cases
  • RAG Benchmark Accuracy Score: NA
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
55
Inference API
Inference API (serverless) has been turned off for this model.

Collection including llmware/llama-3.2-1b-instruct-ov