Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+SOLAR-KOEN-10.8B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,86 @@
+---
+language:
+- ko
+- en
+pipeline_tag: text-generation
+inference: false
+tags:
+- solar
+- mistral
+- pytorch
+- solar-ko
+- TensorBlock
+- GGUF
+library_name: transformers
+license: cc-by-nc-sa-4.0
+base_model: beomi/SOLAR-KOEN-10.8B
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## beomi/SOLAR-KOEN-10.8B - GGUF
+
+This repo contains GGUF format model files for [beomi/SOLAR-KOEN-10.8B](https://huggingface.co/beomi/SOLAR-KOEN-10.8B).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [SOLAR-KOEN-10.8B-Q2_K.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q2_K.gguf) | Q2_K | 3.791 GB | smallest, significant quality loss - not recommended for most purposes |
+| [SOLAR-KOEN-10.8B-Q3_K_S.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q3_K_S.gguf) | Q3_K_S | 4.413 GB | very small, high quality loss |
+| [SOLAR-KOEN-10.8B-Q3_K_M.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q3_K_M.gguf) | Q3_K_M | 4.908 GB | very small, high quality loss |
+| [SOLAR-KOEN-10.8B-Q3_K_L.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q3_K_L.gguf) | Q3_K_L | 5.331 GB | small, substantial quality loss |
+| [SOLAR-KOEN-10.8B-Q4_0.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q4_0.gguf) | Q4_0 | 5.731 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [SOLAR-KOEN-10.8B-Q4_K_S.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q4_K_S.gguf) | Q4_K_S | 5.774 GB | small, greater quality loss |
+| [SOLAR-KOEN-10.8B-Q4_K_M.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q4_K_M.gguf) | Q4_K_M | 6.094 GB | medium, balanced quality - recommended |
+| [SOLAR-KOEN-10.8B-Q5_0.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q5_0.gguf) | Q5_0 | 6.972 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [SOLAR-KOEN-10.8B-Q5_K_S.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q5_K_S.gguf) | Q5_K_S | 6.972 GB | large, low quality loss - recommended |
+| [SOLAR-KOEN-10.8B-Q5_K_M.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q5_K_M.gguf) | Q5_K_M | 7.159 GB | large, very low quality loss - recommended |
+| [SOLAR-KOEN-10.8B-Q6_K.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q6_K.gguf) | Q6_K | 8.291 GB | very large, extremely low quality loss |
+| [SOLAR-KOEN-10.8B-Q8_0.gguf](https://huggingface.co/tensorblock/SOLAR-KOEN-10.8B-GGUF/blob/main/SOLAR-KOEN-10.8B-Q8_0.gguf) | Q8_0 | 10.737 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/SOLAR-KOEN-10.8B-GGUF --include "SOLAR-KOEN-10.8B-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/SOLAR-KOEN-10.8B-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

SOLAR-KOEN-10.8B-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c55798ec2f1858dae00b0138963cbcb7e8a305e226890954c2170d6f162108a1
+size 4071017472

SOLAR-KOEN-10.8B-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5a5675662488389a30b12814544cc85a15a43f85d700592f2880684fece655c0
+size 5724498944

SOLAR-KOEN-10.8B-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e2f8a19508bc415891efb660670137ef484ffb2eef1516c3336589a44378f474
+size 5269416960

SOLAR-KOEN-10.8B-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8a32c8e303163021e931884f37946f9ee454253ae28d43ce8bb5f298b4134923
+size 4738313216

SOLAR-KOEN-10.8B-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2bac99c70d3fda782a670e22e039219cc325c8c1024748c4062eb8344c9e9894
+size 6153931776

SOLAR-KOEN-10.8B-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72aa82fcb2a24d9712ec488da02a7dbbb851b32ad19b00f3a4ffde20c78bba5b
+size 6543215616

SOLAR-KOEN-10.8B-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:13937d66bcd69f9c19a88c19b4f8d05b4954222d4ea535ed150f4d63df575132
+size 6200069120

SOLAR-KOEN-10.8B-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c653e27c3b3a25450a8c7310bc2dadf3c93089117cdad016500eb4fdac331f1
+size 7486278656

SOLAR-KOEN-10.8B-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8435b35f44b78e791ac176b3065dea4cee33430743f39120cb25bd93966441bb
+size 7686818816

SOLAR-KOEN-10.8B-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e90ebe9392be515c5a0696dbbbe1d31459545e5ff25e9fd0d30824e854cb4f98
+size 7486278656

SOLAR-KOEN-10.8B-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1016f832a96bea0ecda65c6255b24bd1d5a15dd2247e0ddd3f8216615ec3c66f
+size 8901897216

SOLAR-KOEN-10.8B-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4613f7ab9e8eb8fdc383fd7b0da836427dd5312d0b7731d2dd0951a77cb73d4c
+size 11529284608