metadata
license: apache-2.0
ggml versions of OpenLLaMa 3B
- Version: 1T tokens final version
- Project: OpenLLaMA: An Open Reproduction of LLaMA
- Model: openlm-research/open_llama_3b
- llama.cpp: build 607(ffb06a3) or later
Use with llama.cpp
Support is now merged to master branch.
Newer quantizations
There are now more quantization types in llama.cpp, some lower than 4 bits. Currently these are not supported, maybe because some weights have shapes that don't divide by 256.