Hugging Face's logo

abacaj
/
Replit-v2-CodeInstruct-3B-ggml

Text Generation
Transformers
mpt
custom_code
text-generation-inference
Model card Files Community
2
abacaj commited on
Commit
c672fd3
•
1 Parent(s): bae228c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -2,4 +2,7 @@
2
  license: other
3
  ---
4
 
5
- This is a ggml quantized version of [Replit-v2-CodeInstruct-3B](https://huggingface.co/teknium/Replit-v2-CodeInstruct-3B). Quantized to 4bit -> q4_1.
 
 
 
 
2
  license: other
3
  ---
4
 
5
+ ---
6
+
7
+ This is a ggml quantized version of [Replit-v2-CodeInstruct-3B](https://huggingface.co/teknium/Replit-v2-CodeInstruct-3B). Quantized to 4bit -> q4_1.
8
+ To run inferene you can use ggml directly or ctranformers (bindings/demo repo to be added): https://github.com/marella/ctransformers