Added short guide about quantization

README.md

@@ -6,7 +6,17 @@
 
 This repository contains the unquantized merge of [limarp-llama2 lora](https://huggingface.co/lemonilia/limarp-llama2) in ggml format.
 
-The below is the contents of the original model card:
+You can quantize the f16 ggml to the quantization of your choice by following the below steps:
+
+1. Download and extract the [llama.cpp binaries](https://github.com/ggerganov/llama.cpp/releases/download/master-41c6741/llama-master-41c6741-bin-win-avx2-x64.zip) ([or compile it yourself if you're on Linux](https://github.com/ggerganov/llama.cpp#build))
+2. Open a command prompt window in the folder where you extracted the binaries and write the following command, making the changes that you see fit.
+```bash
+quantize.exe limarp-llama2-13b.ggmlv3.f16.bin limarp-llama2-13b.ggmlv3.q4_0.bin q4_0
+```
+4. Press enter to run the command and the quantized model will be generated in the current folder.
+
+
+The below are the contents of the original model card:
 
 # Model Card for LIMARP-Llama2