| license: apache-2.0 | |
| # ggml versions of OpenLLaMa 3B | |
| - Version: 1T tokens final version | |
| - Project: [OpenLLaMA: An Open Reproduction of LLaMA](https://github.com/openlm-research/open_llama) | |
| - Model: [openlm-research/open_llama_3b](https://huggingface.co/openlm-research/open_llama_3b) | |
| - [llama.cpp](https://github.com/ggerganov/llama.cpp): build 607(ffb06a3) or later | |
| ## Use with llama.cpp | |
| Support is now merged to master branch. | |
| ## Newer quantizations | |
| There are now more quantization types in llama.cpp, some lower than 4 bits. | |
| Currently these are not supported, maybe because some weights have shapes that don't divide by 256. | |