Quantization made by Richard Erkhov.

[Github](https://github.com/RichardErkhov)

[Discord](https://discord.gg/pvy7H8DZMG)

[Request more models](https://github.com/RichardErkhov/quant_request)


SmolLlamix-8x101M-take2 - bnb 8bits
- Model creator: https://huggingface.co/chargoddard/
- Original model: https://huggingface.co/chargoddard/SmolLlamix-8x101M-take2/




Original model description:
---
license: apache-2.0
datasets:
- togethercomputer/RedPajama-Data-1T-Sample
language:
- en
---

This is another training run of [SmolLlamix-8x101M](https://huggingface.co/chargoddard/SmolLlamix-8x101M) with slightly different hyperparameters. Just testing to see how it holds up against the first run.