uploaded readme

README.md

@@ -0,0 +1,104 @@
+Quantization made by Richard Erkhov.
+
+[Github](https://github.com/RichardErkhov)
+
+[Discord](https://discord.gg/pvy7H8DZMG)
+
+[Request more models](https://github.com/RichardErkhov/quant_request)
+
+
+UCCIX-Llama2-13B - GGUF
+- Model creator: https://huggingface.co/ReliableAI/
+- Original model: https://huggingface.co/ReliableAI/UCCIX-Llama2-13B/
+
+
+| Name | Quant method | Size |
+| ---- | ---- | ---- |
+| [UCCIX-Llama2-13B.Q2_K.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q2_K.gguf) | Q2_K | 4.54GB |
+| [UCCIX-Llama2-13B.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.IQ3_XS.gguf) | IQ3_XS | 5.01GB |
+| [UCCIX-Llama2-13B.IQ3_S.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.IQ3_S.gguf) | IQ3_S | 5.29GB |
+| [UCCIX-Llama2-13B.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q3_K_S.gguf) | Q3_K_S | 5.29GB |
+| [UCCIX-Llama2-13B.IQ3_M.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.IQ3_M.gguf) | IQ3_M | 5.59GB |
+| [UCCIX-Llama2-13B.Q3_K.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q3_K.gguf) | Q3_K | 5.92GB |
+| [UCCIX-Llama2-13B.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q3_K_M.gguf) | Q3_K_M | 5.92GB |
+| [UCCIX-Llama2-13B.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q3_K_L.gguf) | Q3_K_L | 6.47GB |
+| [UCCIX-Llama2-13B.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.IQ4_XS.gguf) | IQ4_XS | 6.56GB |
+| [UCCIX-Llama2-13B.Q4_0.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q4_0.gguf) | Q4_0 | 6.88GB |
+| [UCCIX-Llama2-13B.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.IQ4_NL.gguf) | IQ4_NL | 6.92GB |
+| [UCCIX-Llama2-13B.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q4_K_S.gguf) | Q4_K_S | 6.94GB |
+| [UCCIX-Llama2-13B.Q4_K.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q4_K.gguf) | Q4_K | 7.35GB |
+| [UCCIX-Llama2-13B.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q4_K_M.gguf) | Q4_K_M | 7.35GB |
+| [UCCIX-Llama2-13B.Q4_1.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q4_1.gguf) | Q4_1 | 7.63GB |
+| [UCCIX-Llama2-13B.Q5_0.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q5_0.gguf) | Q5_0 | 8.38GB |
+| [UCCIX-Llama2-13B.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q5_K_S.gguf) | Q5_K_S | 8.38GB |
+| [UCCIX-Llama2-13B.Q5_K.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q5_K.gguf) | Q5_K | 8.62GB |
+| [UCCIX-Llama2-13B.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q5_K_M.gguf) | Q5_K_M | 8.62GB |
+| [UCCIX-Llama2-13B.Q5_1.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q5_1.gguf) | Q5_1 | 9.13GB |
+| [UCCIX-Llama2-13B.Q6_K.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q6_K.gguf) | Q6_K | 9.97GB |
+| [UCCIX-Llama2-13B.Q8_0.gguf](https://huggingface.co/RichardErkhov/ReliableAI_-_UCCIX-Llama2-13B-gguf/blob/main/UCCIX-Llama2-13B.Q8_0.gguf) | Q8_0 | 12.92GB |
+
+
+
+
+Original model description:
+---
+license: apache-2.0
+datasets:
+  - ReliableAI/Irish-Text-Collection
+language:
+  - en
+  - ga
+---
+
+# Model Card for UCCIX-Llama2-13B
+
+
+The UCCIX-Llama2-13B Large Language Model (LLM) is an Irish-English bilingual model, capables of understanding both languages and outperforms much larger models on Irish language tasks.
+The model is based on Llama 2-13B, with vocabulary expansion to include native Irish tokens, and additional continued pre-training on our collection of ~520M Irish tokens (available at https://huggingface.co/datasets/ReliableAI/Irish-Text-Collection).
+
+UCCIX is a pioneering effort on the development of first-ever open-source Irish-based LLM. You can find more details at: https://arxiv.org/abs/2405.13010
+
+Access the instruction-tuned version at https://huggingface.co/ReliableAI/UCCIX-Llama2-13B-Instruct, and interact with it live at: https://aine.chat
+
+## Run the model
+
+Run the model with the transformers library:
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+model_id = "ReliableAI/UCCIX-Llama2-13B-Instruct"
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(model_id,
+                                             device_map="auto",
+                                             dtype=torch.float16 # optional, load in 16-bit precision mode to reduce memory usage
+)
+model.eval()
+
+input = "I love the environment."
+input_ids = tokenizer(input, return_tensors="pt")["input_ids"]
+generated_token_ids = model.generate(
+    inputs=input_ids,
+    max_new_tokens=100,
+    do_sample=True,
+    temperature=0.6,
+    top_p=1,
+)[0]
+generated_text = tokenizer.decode(generated_token_ids)
+```
+
+## Notice
+
+As a pioneering effort, the UCCIX model does not have any moderation mechanisms at the moment. We anticipate collaborating with the community to refine the model's adherence to restrictions so that it can be implemented in settings that demand moderated outcomes.
+
+## Citation
+```
+@misc{tran2024uccix,
+      title={UCCIX: Irish-eXcellence Large Language Model}, 
+      author={Khanh-Tung Tran and Barry O'Sullivan and Hoang D. Nguyen},
+      year={2024},
+      eprint={2405.13010},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL}
+}
+```
+