|
--- |
|
license: llama2 |
|
--- |
|
# Xwin-LM 70B V0.1 - exl2 |
|
- Original model: [Xwin-LM 70B V0.1](https://huggingface.co/Xwin-LM/Xwin-LM-70B-V0.1) |
|
- Original GitHub [Xwin-LM](https://github.com/Xwin-LM/Xwin-LM) |
|
|
|
## Model files |
|
- [4-bpw](https://huggingface.co/firelzrd/Xwin-LM-70B-V0.1-exl2/tree/4-bpw) |
|
- [4.5-bpw](https://huggingface.co/firelzrd/Xwin-LM-70B-V0.1-exl2/tree/4_5-bpw) |
|
- [5-bpw](https://huggingface.co/firelzrd/Xwin-LM-70B-V0.1-exl2/tree/5-bpw) |
|
- [5.15-bpw](https://huggingface.co/firelzrd/Xwin-LM-70B-V0.1-exl2/tree/5_15-bpw) ==> fits in 2x 24GB (=48GB total) GPUs. gpu-split=22,23 |
|
|
