Qwen2-1.5B-Instruct LiteRT-LM Model
This repository contains LiteRT-LM variants of Qwen/Qwen2-1.5B-Instruct optimized for on-device text generation.
Available Artifact
| File | Quantization Recipe | Context | Size |
|---|---|---|---|
Qwen2_1.5B_Instruct.litertlm |
dynamic_wi8_afp32 | - | 1.8 GB |
Integration
Ready to integrate this into your product? Get started in the LiteRT-LM documentation.
- Downloads last month
- -
Model tree for litert-community/Qwen2-1.5B-Instruct
Base model
Qwen/Qwen2-1.5B-Instruct