File size: 248 Bytes
70638fd |
1 2 3 4 5 6 7 8 |
---
pipeline_tag: text-generation
---
5.90 bpw exl2 quant of [c4ai-command-r-plus](https://huggingface.co/CohereForAI/c4ai-command-r-plus)
Fits in 96 GB VRAM with 20k context.
More quants: https://huggingface.co/turboderp/command-r-plus-103B-exl2 |