Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Liph.42-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

Liph.42-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:125c8c4c9aaf2a5eddc63fa7cfcdfde20d703906575b48e6415100c976855fa0
+size 1109719936

Liph.42-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b5874b4473fede022449f92c7bd08bbd317538b0017f16336f72b5c410c64321
+size 1575230336

Liph.42-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad3207cb08896dbb97c747b477d16f510e86ed1e68a33bd3c8cc71665c0aca25
+size 1426135936

Liph.42-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1e135e80632267fb838f4171c19391f43e0192d0b879138cdb369db94b121b7
+size 1250827136

Liph.42-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0248ec85d791de1b1cf96fc62ab6c9e34eea148d29266ae900adbe79d93c5205
+size 1602468736

Liph.42-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:61c5a636bcdcc4e5a51fd014457108bb2ea8d788ae12d5df3541c5f2171ae7af
+size 1737636736

Liph.42-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b60028b1d08f6c78fb637668a976d878e5d190454384f563d672069ea771c06
+size 1618852736

Liph.42-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:426bb78e493afee1ca427973f3ed8bb8c3251e03f6304389163826ed71bcc351
+size 1933425536

Liph.42-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d78088db5a823963b1dafef7ff84d024bc1a3cf965c382ab411828ffa4954935
+size 2003057536

Liph.42-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:facb27dd0f7135bd261727f9f3e8b27dd36428cc547cf41565634aba92db19cc
+size 1933425536

Liph.42-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c1c175122c86281aa98bea8114b9732b43080b695f18a6cbc6a927fcbee82732
+size 2285067136

Liph.42-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c950889a0ebf3726a114314cf56cafe79a13e0d34a159780576e019f30677a39
+size 2958039936

README.md

@@ -0,0 +1,80 @@
+---
+license: apache-2.0
+tags:
+- phi
+- phi2
+- transformers
+- text-generation-inference
+- TensorBlock
+- GGUF
+base_model: liminerity/Liph.42
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## liminerity/Liph.42 - GGUF
+
+This repo contains GGUF format model files for [liminerity/Liph.42](https://huggingface.co/liminerity/Liph.42).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [Liph.42-Q2_K.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q2_K.gguf) | Q2_K | 1.110 GB | smallest, significant quality loss - not recommended for most purposes |
+| [Liph.42-Q3_K_S.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q3_K_S.gguf) | Q3_K_S | 1.251 GB | very small, high quality loss |
+| [Liph.42-Q3_K_M.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q3_K_M.gguf) | Q3_K_M | 1.426 GB | very small, high quality loss |
+| [Liph.42-Q3_K_L.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q3_K_L.gguf) | Q3_K_L | 1.575 GB | small, substantial quality loss |
+| [Liph.42-Q4_0.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q4_0.gguf) | Q4_0 | 1.602 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [Liph.42-Q4_K_S.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q4_K_S.gguf) | Q4_K_S | 1.619 GB | small, greater quality loss |
+| [Liph.42-Q4_K_M.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q4_K_M.gguf) | Q4_K_M | 1.738 GB | medium, balanced quality - recommended |
+| [Liph.42-Q5_0.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q5_0.gguf) | Q5_0 | 1.933 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [Liph.42-Q5_K_S.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q5_K_S.gguf) | Q5_K_S | 1.933 GB | large, low quality loss - recommended |
+| [Liph.42-Q5_K_M.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q5_K_M.gguf) | Q5_K_M | 2.003 GB | large, very low quality loss - recommended |
+| [Liph.42-Q6_K.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q6_K.gguf) | Q6_K | 2.285 GB | very large, extremely low quality loss |
+| [Liph.42-Q8_0.gguf](https://huggingface.co/tensorblock/Liph.42-GGUF/blob/main/Liph.42-Q8_0.gguf) | Q8_0 | 2.958 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/Liph.42-GGUF --include "Liph.42-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/Liph.42-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```