---
license: apache-2.0
tags:
- llama
---
# TinyLlama-1.1B-2T-exl2

EXL2 quants of [TinyLlama/TinyLlama-1.1B-intermediate-step-955k-token-2T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-955k-token-2T) intended for use in speculative decoding.

- [4.0bpw-h6](https://huggingface.co/Doctor-Shotgun/TinyLlama-1.1B-2T-exl2/tree/4.0bpw-h6)
- [6.0bpw-h6](https://huggingface.co/Doctor-Shotgun/TinyLlama-1.1B-2T-exl2/tree/6.0bpw-h6)
- [maxbpw-h8](https://huggingface.co/Doctor-Shotgun/TinyLlama-1.1B-2T-exl2/tree/maxbpw-h8)