Upload folder using huggingface_hub (#1)

- 4bef30ea924a352db8f9545c23277cc50343984592bb007afff60d6865abc358 (4561a55ee4b63512c7bd76e5993fa47aaf4c08b7)
- 8679a99ae0ef99d2b3fd4e6dfe94283343c12449d1ccb3067f7193681139cdff (ac452b3a43ef6245662294456575eefb08ee4e44)
- 925e3c42e58aea50cf101b6c21409f095bc8f666c6f6ce3fdc69840926070e94 (c15cda3ff6f89fe032e8c785061bdfe3cdcfcc8a)
- fd3ac3e9531f1629634f5e03e8f86d75cdd7d8022074705c8d3e63f0e9501501 (7461962f1e9708377198e3d95b02e84e9bf46ee6)
- 2847e5dcc642f47d2339e0ed3982b1b658b8adbec399001d350f5ba248fe76a2 (b0f8979e12c2eb0ba8bcd597dde7248a36361d2f)
- 89b86a7a24456ecd08e2b1bdc7e538f3a74099dea8824f5b939068370d16f940 (f03da0a0b837271bc2d4cc561f6223d1d5b1825f)
- 818c78debfde59ee0e92fbd4f2e8c2ba67eda94b34f97ac46b1f8d02e2923ce4 (bdab69074dbc78bfeb49a5da6c2c7553fcefa273)
- 43555b9155a3683ac7048fa8fd4e8ecdff16b3b4a7688005689fc1bc4da2617f (62b846844cec039c5f42c29388820226b299fce0)
- 3bd45eedaedb5946a1e8bd11f8815a13402adcb51bab13d658d4dd3f0a3f3274 (6de497aea4ac6c58af4eb40f6ae3490d12cdb85b)
- 2b114d14582a35a224cd6c8007db1d93112e405f43f91bf4c2c08f827d1e448d (ff1e802797fbd4eb78b7e96be17c4b9b564aa730)
- f11ca4909cc887f7c843aec0e5cc2a187a25f7dbb98f9250362e9b50b291aedf (4806378645a5d8e5e01fdba640a3ebb62306f07f)

.gitattributes

@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-ties-itmchpd.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,59 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- transformers
+- safetensors
+- mistral
+- text-generation
+- mergekit
+- merge
+- arxiv:2306.01708
+- base_model:mistralai/Mistral-7B-v0.1
+- base_model:mistralai/Mistral-7B-Instruct-v0.2
+- base_model:BioMistral/BioMistral-7B
+- autotrain_compatible
+- endpoints_compatible
+- text-generation-inference
+- region:us
+- text-generation
+model_name: mergekit-ties-itmchpd-GGUF
+base_model: mergekit-community/mergekit-ties-itmchpd
+inference: false
+model_creator: mergekit-community
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/mergekit-ties-itmchpd-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-ties-itmchpd-GGUF)
+- Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
+- Original model: [mergekit-community/mergekit-ties-itmchpd](https://huggingface.co/mergekit-community/mergekit-ties-itmchpd)
+
+## Description
+[MaziyarPanahi/mergekit-ties-itmchpd-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-ties-itmchpd-GGUF) contains GGUF format model files for [mergekit-community/mergekit-ties-itmchpd](https://huggingface.co/mergekit-community/mergekit-ties-itmchpd).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

mergekit-ties-itmchpd.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:968d1dd208e6d6ac995a2582fd3773adf6bfb207ea64275571cdcc14a2043e71
+size 2719242048

mergekit-ties-itmchpd.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c6e3d1044707afe85159440d54f98ea575f0c58adc1605f679178d2bb79c9898
+size 3822024512

mergekit-ties-itmchpd.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc7f594dbadf9e75d9773cb2e0df5286bbe457971826dc760f6ce18d937f9fdd
+size 3518986048

mergekit-ties-itmchpd.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:80531f90bb8e15e4e73189a59fd78c7340d436c5f0d27518c6fb9887f69b8859
+size 3164567360

mergekit-ties-itmchpd.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86df235f8fc66363ad9e780ee3d30269b8dd4c120d37e2bfef2b71a7800803d5
+size 4368439104

mergekit-ties-itmchpd.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bcd288be33657c6ff915433e108624406a3d378ecc18120ba537222cd8d2a4f0
+size 4140373824

mergekit-ties-itmchpd.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3827913e6d080e107c44403399b137454c154f2512279b08be6ba71a9a85caef
+size 5131409216

mergekit-ties-itmchpd.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a7dd552c6ef19d3e6ec622588d86cda743d6addb7dbcc36ac8bdb268594ec83
+size 4997715776

mergekit-ties-itmchpd.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0096b09dff3b066a05f97f0d304ead20eabf54c7ec485b7e6c7bc6f360e63f3f
+size 5942064960

mergekit-ties-itmchpd.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:756a2ae3c02f59a22d5f09df2b473ea9ccb44f367b6663f331cdcce4bd87705a
+size 7695857472