abacaj commited on
Commit
09da5c4
1 Parent(s): 3090956

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -5,6 +5,7 @@ license: other
5
  ---
6
 
7
  This is a [ggml](https://github.com/ggerganov/ggml/) quantized version of [Replit-v2-CodeInstruct-3B](https://huggingface.co/teknium/Replit-v2-CodeInstruct-3B). Quantized to 4bit -> q4_1.
8
- To run inference you can use ggml directly or ctransformers (bindings/demo repo to be added): https://github.com/marella/ctransformers.
9
 
10
- Memory usage of model: **2GB~**
 
 
5
  ---
6
 
7
  This is a [ggml](https://github.com/ggerganov/ggml/) quantized version of [Replit-v2-CodeInstruct-3B](https://huggingface.co/teknium/Replit-v2-CodeInstruct-3B). Quantized to 4bit -> q4_1.
8
+ To run inference you can use ggml directly or [ctransformers](https://github.com/marella/ctransformers).
9
 
10
+ Memory usage of model: **2GB~**
11
+ Repo to run the model using ctransformers: https://github.com/abacaj/replit-3B-inference