Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Vikhr-Gemma-2B-instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,84 @@
+---
+library_name: transformers
+model_name: Vikhr-Gemma-2B-instruct
+base_model: Vikhrmodels/Vikhr-Gemma-2B-instruct
+language:
+- ru
+license: apache-2.0
+datasets:
+- Vikhrmodels/GrandMaster-PRO-MAX
+tags:
+- TensorBlock
+- GGUF
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## Vikhrmodels/Vikhr-Gemma-2B-instruct - GGUF
+
+This repo contains GGUF format model files for [Vikhrmodels/Vikhr-Gemma-2B-instruct](https://huggingface.co/Vikhrmodels/Vikhr-Gemma-2B-instruct).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+<bos><start_of_turn>user
+{prompt}<end_of_turn>
+<start_of_turn>model
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [Vikhr-Gemma-2B-instruct-Q2_K.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q2_K.gguf) | Q2_K | 1.230 GB | smallest, significant quality loss - not recommended for most purposes |
+| [Vikhr-Gemma-2B-instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q3_K_S.gguf) | Q3_K_S | 1.361 GB | very small, high quality loss |
+| [Vikhr-Gemma-2B-instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q3_K_M.gguf) | Q3_K_M | 1.462 GB | very small, high quality loss |
+| [Vikhr-Gemma-2B-instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q3_K_L.gguf) | Q3_K_L | 1.550 GB | small, substantial quality loss |
+| [Vikhr-Gemma-2B-instruct-Q4_0.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q4_0.gguf) | Q4_0 | 1.630 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [Vikhr-Gemma-2B-instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q4_K_S.gguf) | Q4_K_S | 1.639 GB | small, greater quality loss |
+| [Vikhr-Gemma-2B-instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q4_K_M.gguf) | Q4_K_M | 1.709 GB | medium, balanced quality - recommended |
+| [Vikhr-Gemma-2B-instruct-Q5_0.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q5_0.gguf) | Q5_0 | 1.883 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [Vikhr-Gemma-2B-instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q5_K_S.gguf) | Q5_K_S | 1.883 GB | large, low quality loss - recommended |
+| [Vikhr-Gemma-2B-instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q5_K_M.gguf) | Q5_K_M | 1.923 GB | large, very low quality loss - recommended |
+| [Vikhr-Gemma-2B-instruct-Q6_K.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q6_K.gguf) | Q6_K | 2.151 GB | very large, extremely low quality loss |
+| [Vikhr-Gemma-2B-instruct-Q8_0.gguf](https://huggingface.co/tensorblock/Vikhr-Gemma-2B-instruct-GGUF/blob/main/Vikhr-Gemma-2B-instruct-Q8_0.gguf) | Q8_0 | 2.784 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/Vikhr-Gemma-2B-instruct-GGUF --include "Vikhr-Gemma-2B-instruct-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/Vikhr-Gemma-2B-instruct-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

Vikhr-Gemma-2B-instruct-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9302ba5f9d26ddccc83f55c496a486b08da5f19fa4f923f77064c2cc10862073
+size 1229830080

Vikhr-Gemma-2B-instruct-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef2cbf169a8eb29ab034f533a80906bfe95cb25525b8c9a3afaa269ab6ae0209
+size 1550436288

Vikhr-Gemma-2B-instruct-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7227c6ba9375942cd9bc29fc067ec7261c040fc4bebf9220bd3a4803cc595287
+size 1461667776

Vikhr-Gemma-2B-instruct-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2210794d9966250b0180839f8692fc4b651303692e00b577f0db43870657da1f
+size 1360660416

Vikhr-Gemma-2B-instruct-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd727892848d7f0ec98ae87681943982ab579f3de5d012d9c0ffea9c3bdca7bd
+size 1629509568

Vikhr-Gemma-2B-instruct-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e89828bfbccc85814814be5a3581f5bb047bcdb2083a21a325eceec7360298ef
+size 1708582848

Vikhr-Gemma-2B-instruct-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9231c4b32d83ded6e3ff5d209009ab8dbfb246b6a678ece842d9046f2b63fa6
+size 1638651840

Vikhr-Gemma-2B-instruct-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:40aa34699bf1ed1d5b37c959cd47b3ebcf8ee3350dc56b5e1f3ad606646875c7
+size 1882544064

Vikhr-Gemma-2B-instruct-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6d7f9f6be77c3a659cd020577eaeede361335fe6fd3f5669285dfd2e428f70a3
+size 1923278784

Vikhr-Gemma-2B-instruct-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84a167642e2cb45383316889135ecb5d9d6c4b6f823b59380d9aa0e451d5c72a
+size 1882544064

Vikhr-Gemma-2B-instruct-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:abdcb51b5b4095b637f4378ad0c4ef919203f763eea381698bff12c3aadeffad
+size 2151393216

Vikhr-Gemma-2B-instruct-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d634725d389d066d4d174a4441bb827c39dbff6e3856fa494e65d6a68b4ab2f
+size 2784495552