Create README.md

README.md

@@ -0,0 +1,42 @@
+---
+license: openrail
+language:
+- en
+pipeline_tag: text-generation
+library_name: transformers
+---
+
+
+## Original model card 
+
+Buy me a coffee if you like this project ;)
+<a href="https://www.buymeacoffee.com/s3nh"><img src="https://www.buymeacoffee.com/assets/img/guidelines/download-assets-sm-1.svg" alt=""></a>
+
+#### Description 
+
+GGML Format model files for [This project](https://huggingface.co/lmsys/longchat-7b-v1.5-32k/tree/main).
+
+
+### inference 
+
+
+```python
+
+import ctransformers
+
+from ctransformers import AutoModelForCausalLM
+
+model = AutoModelForCausalLM.from_pretrained(output_dir, ggml_file,
+gpu_layers=32, model_type="llama")
+
+manual_input: str = "Tell me about your last dream, please."
+
+
+llm(manual_input, 
+      max_new_tokens=256, 
+      temperature=0.9, 
+      top_p= 0.7)
+
+```
+
+# Original model card