cobrakenji commited on
Commit
c426af7
1 Parent(s): 9b62f2e

update README

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -1,3 +1,18 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
1
  ---
2
  license: apache-2.0
3
+
4
+ This is forked from IBM's [`granite-20b-code-base-GGUF`](https://huggingface.co/ibm-granite/granite-20b-code-base-GGUF) - commit [`d70433a71e2fb9e20f8bfca3ff2d8c15393f0e44`](https://huggingface.co/ibm-granite/granite-20b-code-base-GGUF/commit/d70433a71e2fb9e20f8bfca3ff2d8c15393f0e44).
5
+ Refer to the [original model card](https://huggingface.co/ibm-granite/granite-20b-code-base) for more details.
6
+
7
+ ## Use with llama.cpp
8
+ ```shell
9
+ git clone https://github.com/ggerganov/llama.cpp
10
+ cd llama.cpp
11
+
12
+ # install
13
+ make
14
+
15
+ # run generation
16
+ ./main -m granite-20b-code-base-GGUF/granite-20b-code-base.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
17
+ ```
18
  ---