MaziyarPanahi commited on
Commit
79bd2fa
1 Parent(s): def65ab

Upload folder using huggingface_hub (#1)

Browse files

- cf4cfff02780db7c5f6fdf2573a09b956c260da8d851d0cd161270f28014282b (94336c0677e1040bbc759a227cf1f0fbf4b5540c)
- cae28d7f9cc7d7360dd25c10d2d17e5b928dd6627679db4ec842c6363c004155 (1991d4b7b7e86fdd5f879becd6da511e1ba54730)
- 80d75567717cec946a5e82bf22b5cf9013d47c1b743bdf4d9fc91f02241a297f (08dbc533e84236399aee0b9c33ed2c08ef03431c)
- 3846320aa560f42b4eba4f32cd38b4cecafeea78896cb44346fee54cfe5a4949 (243703e10d0c41f701ac7cfc7e4de40dd217000c)
- 38fcb49274dd40dc3f48a5fe6805d09e3547d1564a85347fc12e3729b230e465 (acf53ffa58185842c62ada7a55aed13b8d79d1bb)
- 003123f7f9a0d14887bd757e2825bc274b1b5634ce4b42d5a153704a3657c08b (2396dea14cd1026b1a80ace0591118ab7a5ddf4a)
- 2d6de0181bebfb5cdcc4afa694af6e294da0d5eb1a0fb77a328bb8305163be5c (7ad6973156375864d45f8f83369c0fd253802b81)
- 3047a93a1b0dc335429ed8cfdd505c2f4e4aa12ae35b335157718ed6ac902920 (869975986ae9fb831ba5d6f6e9423edcac56cb66)
- 4b960f49ce3be14e2edb17bcc5d5ca9a698eea8a9e74fd8af44b74098a5c0b9a (13d2eac19f99a18ffcaaef5cec0ba4984f743a62)
- fb1029127d7f0f3b3532d2869ce6ae4e1a1862c6447aab01297b692d8553c955 (2d361417d0201f347e8f3f766055fda567f5a0d7)
- 33bb327b47f2a154efaad402ec915ec4ebe9c02a73647477783c3c71d565bbea (55a68188f2aca43c9b28af9f1d4353f5812e02b5)

.gitattributes CHANGED
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ mergekit-slerp-xyweuvi.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ mergekit-slerp-xyweuvi.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ mergekit-slerp-xyweuvi.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ mergekit-slerp-xyweuvi.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ mergekit-slerp-xyweuvi.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ mergekit-slerp-xyweuvi.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ mergekit-slerp-xyweuvi.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ mergekit-slerp-xyweuvi.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ mergekit-slerp-xyweuvi.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ mergekit-slerp-xyweuvi.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - transformers
12
+ - safetensors
13
+ - mistral
14
+ - text-generation
15
+ - mergekit
16
+ - merge
17
+ - conversational
18
+ - base_model:HuggingFaceH4/zephyr-7b-beta
19
+ - base_model:Equall/Saul-Base
20
+ - autotrain_compatible
21
+ - endpoints_compatible
22
+ - text-generation-inference
23
+ - region:us
24
+ - text-generation
25
+ model_name: mergekit-slerp-xyweuvi-GGUF
26
+ base_model: mergekit-community/mergekit-slerp-xyweuvi
27
+ inference: false
28
+ model_creator: mergekit-community
29
+ pipeline_tag: text-generation
30
+ quantized_by: MaziyarPanahi
31
+ ---
32
+ # [MaziyarPanahi/mergekit-slerp-xyweuvi-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-slerp-xyweuvi-GGUF)
33
+ - Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
34
+ - Original model: [mergekit-community/mergekit-slerp-xyweuvi](https://huggingface.co/mergekit-community/mergekit-slerp-xyweuvi)
35
+
36
+ ## Description
37
+ [MaziyarPanahi/mergekit-slerp-xyweuvi-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-slerp-xyweuvi-GGUF) contains GGUF format model files for [mergekit-community/mergekit-slerp-xyweuvi](https://huggingface.co/mergekit-community/mergekit-slerp-xyweuvi).
38
+
39
+ ### About GGUF
40
+
41
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
42
+
43
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
44
+
45
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
46
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
47
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
48
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
49
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
50
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
51
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
52
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
53
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
54
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
55
+
56
+ ## Special thanks
57
+
58
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
mergekit-slerp-xyweuvi.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d1d80afce3f3adac77f5e9be67ce990cb4e952f0ddd7249f4b1b54796604ac9
3
+ size 2719242560
mergekit-slerp-xyweuvi.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45287602ed232057ddbd295e16cf1ae529bd3e5693260f5405dde12d74edce79
3
+ size 3822025024
mergekit-slerp-xyweuvi.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:705a3a63573da9ca00738645587cd84cad9e6350978d00407ec75f75705cbdd0
3
+ size 3518986560
mergekit-slerp-xyweuvi.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:980d5a999148c48513f0e272555d84098631bcffc4e65f5b4f326fa2607d38a0
3
+ size 3164567872
mergekit-slerp-xyweuvi.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e6a3e8f2e36ea81d7b3e48af74984b9dd1f60c5223c6bf745bf58df21190619
3
+ size 4368439616
mergekit-slerp-xyweuvi.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8c35819e45fee08384ba0b77bbaf516958a4917690c8b2de3e50c249132a311
3
+ size 4140374336
mergekit-slerp-xyweuvi.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35bacf957ad1e31d770cae3bfab8e8beefe65b9d605735ba0b49c5dd319c6a63
3
+ size 5131409728
mergekit-slerp-xyweuvi.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c5ad1838f0a89a46d43e1a705fa1bca4b8a0f45c8423b4f077c9853517495a7
3
+ size 4997716288
mergekit-slerp-xyweuvi.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ddd218c3dbfeb7212add535c138c47e0ec43d4f6b90669fabdbfb30eeb38b3c
3
+ size 5942065472
mergekit-slerp-xyweuvi.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c774194880e7a6d9b0e61372ec2cb11fc2e5e27e8a0c6d69a0cc1a4bfb95380f
3
+ size 7695857984