MaziyarPanahi commited on
Commit
174ba11
1 Parent(s): 10132a1

Upload folder using huggingface_hub (#1)

Browse files

- a602eb48264f7b4341461dd86819a0643dce1bb78919b25dbb32d951ee711c89 (57df0cd9744f7cbc45ad42e5a20eab29116ceec8)
- 0412d4185f614ccaf5bde9a824e2595b55b7fe627822b457a4121ed2fb51af3f (585e75c9187cfb7bfc15bd5a47fd2e18b53071fa)
- 939097d0f92d4f5921a85a63a70e4a33ba0c52c0700484cc0539cc92a58afdce (b915a696d6d65637524dc6299e0c7ce4c5dc27ce)
- bf7116217c02243a0337ee06239bb1fbe78102141a49387eac591b1a10b2e33c (98ac85de15985f549d8c936f5a14f8c81a66b823)
- c980670a89fac77f3cac606b97f323f45929f853a4cafe79d55c959baee116e7 (d4e9740f10804e297b0b7f94c0edd3e80688293c)
- 7ee74dfbce69f87b4640feb67fb0d1ca34d1310900f4dffb6ddf0f0ef328c97f (0c1954b8bc76c255918778557cfd4c1eed3c54f3)
- 99790d2ee6775916e081cc3f976cb7fb2a84209788d09499805677018e920eb4 (eafe2f6fad88f42d6bb0734de84e0a0b5248d751)
- 24351101a4161c493d5db63a8628d38b73f2c497e99eb7d3c279119ff150d2d0 (22ab7840447d61f286744892b8a058842c5dcff9)
- 511c884de59cd4236a4a513d87ffe7bb4a4eb7bdd6a45efb2eec1f24bddc9871 (0c5e7a20286e0450fe34f727aae56931770e7ef9)
- c86e5afd23924b76f4e1adeb5d95d0d599829f2c50c9d3571492fbab01973595 (af0f5fc7d280a0259696313b4d63b11b8c999464)
- 59700d3d4e75cb4736ff23f17171ed10ad920e10dd38e452508e68c6eacdc6b8 (274ae54eca2cf544b3a13c89f404456563829cdc)

.gitattributes CHANGED
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ mergekit-passthrough-zpfenfn.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ mergekit-passthrough-zpfenfn.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ mergekit-passthrough-zpfenfn.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ mergekit-passthrough-zpfenfn.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ mergekit-passthrough-zpfenfn.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ mergekit-passthrough-zpfenfn.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ mergekit-passthrough-zpfenfn.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ mergekit-passthrough-zpfenfn.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ mergekit-passthrough-zpfenfn.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ mergekit-passthrough-zpfenfn.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - transformers
12
+ - safetensors
13
+ - llama
14
+ - text-generation
15
+ - mergekit
16
+ - merge
17
+ - conversational
18
+ - base_model:cognitivecomputations/dolphin-2.9.1-yi-1.5-34b
19
+ - autotrain_compatible
20
+ - endpoints_compatible
21
+ - text-generation-inference
22
+ - region:us
23
+ - text-generation
24
+ model_name: mergekit-passthrough-zpfenfn-GGUF
25
+ base_model: mergekit-community/mergekit-passthrough-zpfenfn
26
+ inference: false
27
+ model_creator: mergekit-community
28
+ pipeline_tag: text-generation
29
+ quantized_by: MaziyarPanahi
30
+ ---
31
+ # [MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF)
32
+ - Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
33
+ - Original model: [mergekit-community/mergekit-passthrough-zpfenfn](https://huggingface.co/mergekit-community/mergekit-passthrough-zpfenfn)
34
+
35
+ ## Description
36
+ [MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF) contains GGUF format model files for [mergekit-community/mergekit-passthrough-zpfenfn](https://huggingface.co/mergekit-community/mergekit-passthrough-zpfenfn).
37
+
38
+ ### About GGUF
39
+
40
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
41
+
42
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
43
+
44
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
45
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
46
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
47
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
48
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
49
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
50
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
51
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
52
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
53
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
54
+
55
+ ## Special thanks
56
+
57
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
mergekit-passthrough-zpfenfn.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee03fd8d591af6e0f3d4ca2ba1e1051b9aa94b50651310f49838138370b01cfd
3
+ size 8726274080
mergekit-passthrough-zpfenfn.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd34f3eb505d90d0d0adc09d766ce700c5b3ae92ab4c033b77063dd03d96472c
3
+ size 12284612640
mergekit-passthrough-zpfenfn.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f23b9a9a5e3fb3e4a31bf81f5f0265d40a1f09fa7f3cb5a3749ff20517a230a2
3
+ size 11295543328
mergekit-passthrough-zpfenfn.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31d1aff1e4bd35e68ce2923d9d4d6efa7dc3867a3c4e30a938a4d31b861589c9
3
+ size 10165178400
mergekit-passthrough-zpfenfn.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24c1e99d0e0ebdfab2b295ace025d2de93f62cd47cd1b3864f0c0a9a7623725a
3
+ size 13984432160
mergekit-passthrough-zpfenfn.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ac725c439ad6184f38262748c7bf27c6390a9bb49ec826c63d2e92c94954e6c
3
+ size 13285064736
mergekit-passthrough-zpfenfn.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b24ad8f93a11584846bf74c0266be846ed0a5e9cbc4943f1859c1900d5f2c074
3
+ size 16445636640
mergekit-passthrough-zpfenfn.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aad9047d51b8989dc8f32fb3563996538334dec09502681a2209140d21be4d83
3
+ size 16036200480
mergekit-passthrough-zpfenfn.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33aa1bd09b03640d3cfffcc609efd7eabbb60b8daf70a223188ca5be38f4174c
3
+ size 19060666400
mergekit-passthrough-zpfenfn.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db8c57fd733d04b182ec236d1e7d2e5a3bfa55d285e9da9e82fa0a966e54a184
3
+ size 24686972960