Upload folder using huggingface_hub (#1)

- d6e53580be73e90d10d44dab369dad7c5b9c8ff348f5d14336a9501945cb9d1e (9a880dc034cf2a3304b2feb89375ea6f6c2b5468)
- 9f45a0598c0068640a5d3913a4963b0166a1e9f6038ca8212c2b2c3e06eb6e54 (d35f34c15dfecb7022b0c9e4c719846e9c1fc1ab)
- ffa651ba29fee1844dcc28b3e8c658c1584075e90177c16f67e4de31f87463ec (6756469c2e5d3fdd120cfe4f89fc27a460aef61b)
- a34fd32e3a2fa08cbce4161e90b507b6221b25add6b218c6d04d3e1280e71a1f (918dabc03a2f0216adfdc9705ac54f3a23c3bb94)
- 98cfdb952d2495583439c8be8ad9ffc0e6c720ab6c382b45b037a7c832bd98f9 (6fb79afd018c9ffe33b00177b6e1817becbadb3c)
- 1e7391d52af55a182335d750f9b85b1bc4b5318840d8fb91ecafa6cdc91c0669 (79f0b145e85dcde65e7b6c1aca21881951aeb27f)
- 84d791dbd0ccf96729f6e855f92a71fdac87d6734c1a2ccf50e3bff5787efae9 (290ba677446cbbcddaebb509c256a26024058408)
- b6925d958fe42a5e3840d10068f77126f2c6bfc0519c4a80003bc2e5a1a5cd5c (6db398283c57e3858c1326e3bc1ec870e0441b40)
- 19dd34bcbe1c8b65cc2eec578c0f761cf132a5997286a740d9517984390932cd (6d5e7c3b14c23cb0175059c09500e3702bf6721e)
- 5cbe4a0d582f9afa66b9ff39ec02632cf76ad15735b286d5a63c6d450c55daff (c49423bcdbd8e6626749a3c5e323d0c20427e63b)

.gitattributes

@@ -33,3 +33,12 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Yi-1.5-9B-Chat.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,56 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- transformers
+- safetensors
+- llama
+- text-generation
+- conversational
+- arxiv:2403.04652
+- license:apache-2.0
+- autotrain_compatible
+- endpoints_compatible
+- text-generation-inference
+- region:us
+- text-generation
+model_name: Yi-1.5-9B-Chat-GGUF
+base_model: 01-ai/Yi-1.5-9B-Chat
+inference: false
+model_creator: 01-ai
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/Yi-1.5-9B-Chat-GGUF](https://huggingface.co/MaziyarPanahi/Yi-1.5-9B-Chat-GGUF)
+- Model creator: [01-ai](https://huggingface.co/01-ai)
+- Original model: [01-ai/Yi-1.5-9B-Chat](https://huggingface.co/01-ai/Yi-1.5-9B-Chat)
+
+## Description
+[MaziyarPanahi/Yi-1.5-9B-Chat-GGUF](https://huggingface.co/MaziyarPanahi/Yi-1.5-9B-Chat-GGUF) contains GGUF format model files for [01-ai/Yi-1.5-9B-Chat](https://huggingface.co/01-ai/Yi-1.5-9B-Chat).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

Yi-1.5-9B-Chat.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36729dd8c0072ddd9c40707bc1cfee9ee7c63ddeefc5f4544bd55e593b6414c1
+size 3354325280

Yi-1.5-9B-Chat.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3d4f7a5fe3f85d4e87e5f4000139d634d1cfb0d7e0f3c02d51940d4037f13cb
+size 4690751776

Yi-1.5-9B-Chat.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca94932b0f785d964411c6703dc2a4dfea3dfb44fa1922c59b0773e52e4b4ec9
+size 4324405536

Yi-1.5-9B-Chat.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2737ba16ee9c70975141f7abb025206380fea20ccc2bd05408bbf1f414b0eec7
+size 3899207968

Yi-1.5-9B-Chat.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bae824bdb0f3a333714bafffcbb64cf5cba7259902cd2f20a0fec6efbc6c1e5a
+size 5328957728

Yi-1.5-9B-Chat.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ed86f4303207e1361f00089f5d8e290322001b7e9291409aca103f16d4585fe
+size 5071860000

Yi-1.5-9B-Chat.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e5a4ee3789acc9551742c0140ef19d45596c7a0598b8c1b8e166f780d726baff
+size 6258258208

Yi-1.5-9B-Chat.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db26c8a3d1af87fe944bd6289ec81467ef9ba6dfe60794ab90d0dfae1cb58001
+size 6107853088

Yi-1.5-9B-Chat.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e13bc65e4fbe234da8a2b33e8021e9bc253da53d7a99600e2dab2c746c8f5c7
+size 7245639968