mayank-mishra
commited on
Commit
•
c15b80d
1
Parent(s):
8d8a59d
update readme
Browse files
README.md
CHANGED
@@ -225,9 +225,9 @@ model-index:
|
|
225 |
|
226 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62cd5057674cdb524450093d/1hzxoPwqkBJXshKVVe6_9.png)
|
227 |
|
228 |
-
# ibm-granite/granite-20b-code-base-
|
229 |
-
This
|
230 |
-
Refer to the [original model card](https://huggingface.co/ibm-granite/granite-20b-code-base) for more details
|
231 |
|
232 |
## Use with llama.cpp
|
233 |
```shell
|
@@ -238,5 +238,5 @@ cd llama.cpp
|
|
238 |
make
|
239 |
|
240 |
# run generation
|
241 |
-
./main -m granite-20b-code-base-
|
242 |
```
|
|
|
225 |
|
226 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62cd5057674cdb524450093d/1hzxoPwqkBJXshKVVe6_9.png)
|
227 |
|
228 |
+
# ibm-granite/granite-20b-code-base-GGUF
|
229 |
+
This is the Q4_K_M converted version of the original [`ibm-granite/granite-20b-code-base`](https://huggingface.co/ibm-granite/granite-20b-code-base).
|
230 |
+
Refer to the [original model card](https://huggingface.co/ibm-granite/granite-20b-code-base) for more details.
|
231 |
|
232 |
## Use with llama.cpp
|
233 |
```shell
|
|
|
238 |
make
|
239 |
|
240 |
# run generation
|
241 |
+
./main -m granite-20b-code-base-GGUF/granite-20b-code-base.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
|
242 |
```
|