stablelm-2-zephyr-1_6b-ov

stablelm-2-zephyr-1_6-ov is an OpenVino int4 quantized version of Zephyr finetune of StableLM 1.6B.

stablelm-2-zephyr-1_6b is a popular, small chat model from StabilityAI.

Model Description

• Developed by: stabilityai
• Quantized by: llmware
• Model type: stablelm-1_6b
• Parameters: 1.6 billion
• Model Parent: stabilityai/stablelm-zephyr-1_6b
• Language(s) (NLP): English
• License: CC-By-SA-4.0
• Uses: General chat
• RAG Benchmark Accuracy Score: NA
• Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website