| license: openrail | |
| pipeline_tag: text-generation | |
| library_name: transformers | |
| language: | |
| - zh | |
| - en | |
| ## Original model card | |
| Buy me a coffee if you like this project ;) | |
| <a href="https://www.buymeacoffee.com/s3nh"><img src="https://www.buymeacoffee.com/assets/img/guidelines/download-assets-sm-1.svg" alt=""></a> | |
| #### Description | |
| GGML Format model files for [This project](https://huggingface.co/Photolens/OpenOrcaxOpenChat-2-13b-langchain-chat). | |
| ### inference | |
| ```python | |
| import ctransformers | |
| from ctransformers import AutoModelForCausalLM | |
| model = AutoModelForCausalLM.from_pretrained(output_dir, ggml_file, | |
| gpu_layers=32, model_type="llama") | |
| manual_input: str = "Tell me about your last dream, please." | |
| llm(manual_input, | |
| max_new_tokens=256, | |
| temperature=0.9, | |
| top_p= 0.7) | |
| ``` | |
| # Original model card | |