Granite Code Models
Collection
A series of code models trained by IBM licensed under Apache 2.0 license. We release both the base pretrained and instruct models.
•
25 items
•
Updated
•
149
This is the Q4_K_M converted version of the original ibm-granite/granite-20b-code-instruct
.
Refer to the original model card for more details.
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
# install
make
# run generation
./main -m granite-20b-code-instruct-GGUF/granite-20b-code-instruct.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
Base model
ibm-granite/granite-20b-code-base