shenzhi-wang commited on
Commit
008d217
1 Parent(s): 1293eb9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -99,3 +99,9 @@ outputs = model.generate(
99
  response = outputs[0][input_ids.shape[-1] :]
100
  print(tokenizer.decode(response, skip_special_tokens=True))
101
  ```
 
 
 
 
 
 
 
99
  response = outputs[0][input_ids.shape[-1] :]
100
  print(tokenizer.decode(response, skip_special_tokens=True))
101
  ```
102
+
103
+ ## 2.2 Usage of Our GGUF Models
104
+
105
+ 1. Download our GGUF models from the [gguf_models folder](https://huggingface.co/shenzhi-wang/Gemma-2-27B-Chinese-Chat/tree/main/gguf_models).
106
+ 2. Use the GGUF models with [LM Studio](https://lmstudio.ai/) version 0.2.26.
107
+