Create README.md

README.md

@@ -0,0 +1,45 @@
+---
+license: cc-by-sa-4.0
+language:
+- en
+tags:
+- text-generation-inference
+pipeline_tag: text-generation
+---
+
+
+## Original model card 
+
+Buy me a coffee if you like this project ;)
+<a href="https://www.buymeacoffee.com/s3nh"><img src="https://www.buymeacoffee.com/assets/img/guidelines/download-assets-sm-1.svg" alt=""></a>
+
+#### Description 
+
+GGML Format model files for [This project](https://huggingface.co/CobraMamba/mamba-gpt-3b-v3).
+
+
+### inference 
+
+
+```python
+
+import ctransformers
+
+from ctransformers import AutoModelForCausalLM
+
+model = AutoModelForCausalLM.from_pretrained(output_dir, ggml_file,
+gpu_layers=32, model_type="llama")
+
+manual_input: str = "Tell me about your last dream, please."
+
+
+llm(manual_input, 
+      max_new_tokens=256, 
+      temperature=0.9, 
+      top_p= 0.7)
+
+```
+
+
+
+# Original model card