Update README.md

README.md

@@ -38,16 +38,5 @@ Astra-v1-12B can be used directly for a wide range of NLP tasks, including:
 ### Out-of-Scope Use
 
 Astra-v1-12B is not intended for real-time decision-making in critical applications or generating harmful or biased content.
-## How to Get Started with the Model
-
-```python
-from transformers import AutoModelForCausalLM, AutoTokenizer
-
-tokenizer = AutoTokenizer.from_pretrained("P0x0/astra-v1-12b")
-model = AutoModelForCausalLM.from_pretrained("P0x0/astra-v1-12b")
-
-input_text = "Explain the theory of relativity in simple terms."
-inputs = tokenizer(input_text, return_tensors="pt")
-outputs = model.generate(**inputs)
-
-print(tokenizer.decode(outputs[0], skip_special_tokens=True))
+## How to Get Started with the quantized model
+To run the quantized version of the model, you can use [KoboldCPP](https://github.com/LostRuins/koboldcpp), which allows you to run quantized GGUF models locally.