File size: 641 Bytes
dd06fa5 aa6fce5 a8f706c aa6fce5 a8f706c 20d915b aa6fce5 20d915b a8f706c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
license: apache-2.0
---
# ggml versions of OpenLLaMa 3B
- Version: 1T tokens final version
- Project: [OpenLLaMA: An Open Reproduction of LLaMA](https://github.com/openlm-research/open_llama)
- Model: [openlm-research/open_llama_3b](https://huggingface.co/openlm-research/open_llama_3b)
- [llama.cpp](https://github.com/ggerganov/llama.cpp): build 607(ffb06a3) or later
## Use with llama.cpp
Support is now merged to master branch.
## Newer quantizations
There are now more quantization types in llama.cpp, some lower than 4 bits.
Currently these are not supported, maybe because some weights have shapes that don't divide by 256.
|