README.md

---
datasets:
- ClusterlabAi/InstAr-500k
- CohereForAI/aya_dataset
language:
- ar
tags:
- causal-lm
- llama-cpp
- gguf-my-repo
extra_gated_prompt: "### STABILITY AI NON-COMMERCIAL RESEARCH COMMUNITY LICENSE AGREEMENT\t\
  \  \n\nDated: November 20, 2024 \n\n**By clicking “I Accept” below or by using or\
  \ distributing any portion or element of the Models, Software, Software Products\
  \ or Derivative Works, you agree to the terms of this License. If you do not agree\
  \ to this License, then you do not have any rights to use the Software Products\
  \ or Derivative Works through this License, and you must immediately cease using\
  \ the Software Products or Derivative Works. If you are agreeing to be bound by\
  \ the terms of this License on behalf of your employer or other entity, you represent\
  \ and warrant to Stability AI that you have full legal authority to bind your employer\
  \ or such entity to this License. If you do not have the requisite authority, you\
  \ may not accept the License or access the Software Products or Derivative Works\
  \ on behalf of your employer or other entity.**\n\n “Agreement“ means this Stable\
  \ Non-Commercial Research Community License Agreement.\n\n“AUP” means the Stability\
  \ AI Acceptable Use Policy available at [https://stability.ai/use-policy](https://stability.ai/use-policy),\
  \ as may be updated from time to time.\n\n“Derivative Work(s)” means (a) any derivative\
  \ work of the Software Products as recognized by U.S. copyright laws, (b) any modifications\
  \ to a Model, and (c) any other model created which is based on or derived from\
  \ the Model or the Model’s output. For clarity, Derivative Works do not include\
  \ the output of any Model.\n\n“Documentation” means any specifications, manuals,\
  \ documentation, and other written information provided by Stability AI related\
  \ to the Software.\n\n “Licensee“ or “you“ means you, or your employer or any other\
  \ person or entity (if you are entering into this Agreement on such person or entity's\
  \ behalf), of the age required under applicable laws, rules or regulations to provide\
  \ legal consent and that has legal authority to bind your employer or such other\
  \ person or entity if you are entering in this Agreement on their behalf.\n\n“Model(s)“\
  \ means, collectively, Stability AI’s proprietary models and algorithms, including\
  \ machine-learning models, trained model weights and other elements of the foregoing,\
  \ made available under this Agreement.\n\n“Non-Commercial Uses” means exercising\
  \ any of the rights granted herein for the purpose of research or non-commercial\
  \ purposes. Non-Commercial Uses does not include any production use of the Software\
  \ Products or any Derivative Works. \n\n“Stability AI“ or “we“ means Stability AI\
  \ Ltd and its affiliates.\n\n“Software“ means Stability AI’s proprietary software\
  \ made available under this Agreement. \n\n“Software Products” means the Models,\
  \ Software and Documentation, individually or in any combination. \n\n**1. License\
  \ Rights and Redistribution.** \na. Subject to your compliance with this Agreement,\
  \ the AUP (which is hereby incorporated herein by reference), and the Documentation,\
  \ Stability AI grants you a non-exclusive, worldwide, non-transferable, non-sublicensable,\
  \ revocable, royalty free and limited license under Stability AI’s intellectual\
  \ property or other rights owned or controlled by Stability AI embodied in the Software\
  \ Products to use, reproduce, distribute, and create Derivative Works of, the Software\
  \ Products, in each case for Non-Commercial Uses only. \n\nb. You may not use the\
  \ Software Products or Derivative Works to enable third parties to use the Software\
  \ Products or Derivative Works as part of your hosted service or via your APIs,\
  \ whether you are adding substantial additional functionality thereto or not. Merely\
  \ distributing the Software Products or Derivative Works for download online without\
  \ offering any related service (ex. by distributing the Models on HuggingFace) is\
  \ not a violation of this subsection. If you wish to use the Software Products or\
  \ any Derivative Works for commercial or production use or you wish to make the\
  \ Software Products or any Derivative Works available to third parties via your\
  \ hosted service or your APIs, contact Stability AI at [https://stability.ai/contact](https://stability.ai/contact).\
  \    \n\nc. If you distribute or make the Software Products, or any Derivative Works\
  \ thereof, available to a third party, the Software Products, Derivative Works,\
  \ or any portion thereof, respectively, will remain subject to this Agreement and\
  \ you must (i) provide a copy of this Agreement to such third party, and (ii) retain\
  \ the following attribution notice within a “Notice“ text file distributed as a\
  \ part of such copies: “This Stability AI Model is licensed under the Stability\
  \ AI Non-Commercial Research Community License, Copyright (c) Stability AI Ltd.\
  \ All Rights Reserved.“ If you create a Derivative Work of a Software Product, you\
  \ may add your own attribution notices to the Notice file included with the Software\
  \ Product, provided that you clearly indicate which attributions apply to the Software\
  \ Product and you must state in the NOTICE file that you changed the Software Product\
  \ and how it was modified.\n\n**2. Disclaimer of Warranty**. UNLESS REQUIRED BY\
  \ APPLICABLE LAW, THE SOFTWARE PRODUCTS  AND ANY OUTPUT AND RESULTS THEREFROM ARE\
  \ PROVIDED ON AN “AS IS“ BASIS, WITHOUT WARRANTIES OF ANY KIND, EITHER EXPRESS OR\
  \ IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT,\
  \ MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE\
  \ FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE SOFTWARE PRODUCTS,\
  \ DERIVATIVE WORKS OR ANY OUTPUT OR RESULTS AND ASSUME ANY RISKS ASSOCIATED WITH\
  \ YOUR USE OF THE SOFTWARE PRODUCTS, DERIVATIVE WORKS AND ANY OUTPUT AND RESULTS. \n\
  \n**3. Limitation of Liability.** IN NO EVENT WILL STABILITY AI OR ITS AFFILIATES\
  \ BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE,\
  \ PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST\
  \ PROFITS OR ANY DIRECT, INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY\
  \ OR PUNITIVE DAMAGES, EVEN IF STABILITY AI OR ITS AFFILIATES HAVE BEEN ADVISED\
  \ OF THE POSSIBILITY OF ANY OF THE FOREGOING. \n\n**4. Intellectual Property.**\n\
  a. No trademark licenses are granted under this Agreement, and in connection with\
  \ the Software Products or Derivative Works, neither Stability AI nor Licensee may\
  \ use any name or mark owned by or associated with the other or any of its affiliates,\
  \ except as required for reasonable and customary use in describing and redistributing\
  \ the Software Products or Derivative Works. \n\nb. Subject to Stability AI’s ownership\
  \ of the Software Products and Derivative Works made by or for Stability AI, with\
  \ respect to any Derivative Works that are made by you, as between you and Stability\
  \ AI, you are and will be the owner of such Derivative Works. \n\nc. If you institute\
  \ litigation or other proceedings against Stability AI (including a cross-claim\
  \ or counterclaim in a lawsuit) alleging that the Software Products, Derivative\
  \ Works or associated outputs or results, or any portion of any of the foregoing,\
  \ constitutes infringement of intellectual property or other rights owned or licensable\
  \ by you, then any licenses granted to you under this Agreement shall terminate\
  \ as of the date such litigation or claim is filed or instituted. You will indemnify\
  \ and hold harmless Stability AI from and against any claim by any third party arising\
  \ out of or related to your use or distribution of the Software Products or Derivative\
  \ Works in violation of this Agreement. \n\n**5. Term and Termination**. The term\
  \ of this Agreement will commence upon your acceptance of this Agreement or access\
  \ to the Software Products and will continue in full force and effect until terminated\
  \ in accordance with the terms and conditions herein. Stability AI may terminate\
  \ this Agreement if you are in breach of any term or condition of this Agreement.\
  \ Upon termination of this Agreement, you shall delete and cease use of any Software\
  \ Products or Derivative Works. Sections 2-4 shall survive the termination of this\
  \ Agreement. \n\n**6. Governing Law.** This Agreement will be governed by and construed\
  \ in accordance with the laws of the United States and the State of California without\
  \ regard to choice of law principles. \n\n [Please learn more about our self-hosted\
  \ Membership options here](https://stability.ai/license)."
extra_gated_fields:
  Name: text
  Email: text
  Country: text
  Organization or Affiliation: text
  I ALLOW Stability AI to email me about new model releases: checkbox
  ? By clicking here, you accept the License agreement, and will use the Software
    Products and Derivative Works for non-commercial or research purposes only A commercial
    license is required to self-host the Software Products for commercial purposes,
    (Please learn more about our self-hosted Membership options on our website linked
    above)
  : checkbox
  ? By clicking here, you agree to sharing with Stability AI the information contained
    within this form and that Stability AI can contact you for the purposes of marketing
    our products and services Yes, I consent to receiving Stability AI marketing communications
  : checkbox
extra_gated_button_content: Submit
license:
- other
base_model: stabilityai/ar-stablelm-2-chat
---

# IbnAbdeen/ar-stablelm-2-chat-Q4_K_M-GGUF
This model was converted to GGUF format from [`stabilityai/ar-stablelm-2-chat`](https://huggingface.co/stabilityai/ar-stablelm-2-chat) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
Refer to the [original model card](https://huggingface.co/stabilityai/ar-stablelm-2-chat) for more details on the model.

## Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)

```bash
brew install llama.cpp

```
Invoke the llama.cpp server or the CLI.

### CLI:
```bash
llama-cli --hf-repo IbnAbdeen/ar-stablelm-2-chat-Q4_K_M-GGUF --hf-file ar-stablelm-2-chat-q4_k_m.gguf -p "The meaning to life and the universe is"
```

### Server:
```bash
llama-server --hf-repo IbnAbdeen/ar-stablelm-2-chat-Q4_K_M-GGUF --hf-file ar-stablelm-2-chat-q4_k_m.gguf -c 2048
```

Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.

Step 1: Clone llama.cpp from GitHub.
```
git clone https://github.com/ggerganov/llama.cpp
```

Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
```
cd llama.cpp && LLAMA_CURL=1 make
```

Step 3: Run inference through the main binary.
```
./llama-cli --hf-repo IbnAbdeen/ar-stablelm-2-chat-Q4_K_M-GGUF --hf-file ar-stablelm-2-chat-q4_k_m.gguf -p "The meaning to life and the universe is"
```
or 
```
./llama-server --hf-repo IbnAbdeen/ar-stablelm-2-chat-Q4_K_M-GGUF --hf-file ar-stablelm-2-chat-q4_k_m.gguf -c 2048
```