Hugging Face's logo

MaziyarPanahi
/
T3qm7Strangemerges_32-7B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
Model card Files Community
1
MaziyarPanahi commited on
Commit
2d1aeb8
•
1 Parent(s): d62a6ba

Upload folder using huggingface_hub (#1)

Browse files

- ba018350690502f748e3b59391b5bd1e4f55884d71d6aa3db1e6ac92faf6fe61 (186fc4ca933455de593b1182f73d5ac5934a410a)
- 377131a8a7e97a7bdd895f8bfe80cdb7a2ae97ed386ec1f4d05b9ec95bb1503c (d5228a36389560e8eb9d0ab48f5143ed2d346a8d)
- 1650231f3394bed5ea694bb6fc96057108c5c18bf8cc34847fd1e8007e863f82 (55467ad2769a25c981ee5f9cc8312e5de8cbd94b)
- 93aad1954f520ea3057ef3beda77c8abb376fcf2abb12e312131e9f0f1a1ebda (bed715ddb44fa457ca9a0c1e0a70d3f3366ae81d)
- 7049e5f9b57bb5d99f49f9db6b3bd7b20736dfeb987cb463eac92905dfe40b86 (a83b60a27848ee13b3938cab106afd889ff14474)
- 796f179baf6bffe26890a7eb607000171e598bd3bcabd6edbf97df780a6077f9 (5e5b13526a5bfcfa61ca5646dc0f25825c64dc8b)
- e2976f33a6912b23febc0a158ae64cd6613198437a71b00647760af19ad54457 (5582375592c0062136742bce1e0740d371b1b953)
- d3be22f40973b38b1e4b03afab873d6aac0e6e6cf9d87484f78dfbb8c493e542 (74610bf42dbacdbbc0cc8bde70faa9ec122f5c23)
- 0fbf050dd0389ddc5e8204faac3884aca258d9e26f3ccb646c4f9ab7c4361246 (5d8cd77acd007bc0f9d58973d9ff48bd6dd18791)
- 7f2794317dd5b7d6d8c3d0e9b1edfb32080f67693de126e6f4c66380005a6409 (0b4bc1e838e84afda5270c6d744d55df1ea84073)
- 5e56f6d4a81c0f94f47a157a57b9f78ef4f5109a8289eb68efecb2b50917661d (4134eaa23fa76666264060d51f9f3a59c5e21489)
- 867a228260773f612442cf671f0ea39382baf138a2b4fe87359074acc3f061f2 (57c34eb6734050c259a6a08ef8561f8987b092e6)

Files changed (13) hide show
  1. .gitattributes +11 -0
  2. README.md +60 -0
  3. T3qm7Strangemerges_32-7B.Q2_K.gguf +3 -0
  4. T3qm7Strangemerges_32-7B.Q3_K_L.gguf +3 -0
  5. T3qm7Strangemerges_32-7B.Q3_K_M.gguf +3 -0
  6. T3qm7Strangemerges_32-7B.Q3_K_S.gguf +3 -0
  7. T3qm7Strangemerges_32-7B.Q4_K_M.gguf +3 -0
  8. T3qm7Strangemerges_32-7B.Q4_K_S.gguf +3 -0
  9. T3qm7Strangemerges_32-7B.Q5_K_M.gguf +3 -0
  10. T3qm7Strangemerges_32-7B.Q5_K_S.gguf +3 -0
  11. T3qm7Strangemerges_32-7B.Q6_K.gguf +3 -0
  12. T3qm7Strangemerges_32-7B.Q8_0.gguf +3 -0
  13. T3qm7Strangemerges_32-7B.fp16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ T3qm7Strangemerges_32-7B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ T3qm7Strangemerges_32-7B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ T3qm7Strangemerges_32-7B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ T3qm7Strangemerges_32-7B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ T3qm7Strangemerges_32-7B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ T3qm7Strangemerges_32-7B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ T3qm7Strangemerges_32-7B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ T3qm7Strangemerges_32-7B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ T3qm7Strangemerges_32-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ T3qm7Strangemerges_32-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
+ T3qm7Strangemerges_32-7B.fp16.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - transformers
12
+ - safetensors
13
+ - mistral
14
+ - text-generation
15
+ - merge
16
+ - mergekit
17
+ - lazymergekit
18
+ - automerger
19
+ - base_model:nlpguy/T3QM7
20
+ - base_model:Gille/StrangeMerges_32-7B-slerp
21
+ - license:apache-2.0
22
+ - autotrain_compatible
23
+ - endpoints_compatible
24
+ - text-generation-inference
25
+ - region:us
26
+ - text-generation
27
+ model_name: T3qm7Strangemerges_32-7B-GGUF
28
+ base_model: automerger/T3qm7Strangemerges_32-7B
29
+ inference: false
30
+ model_creator: automerger
31
+ pipeline_tag: text-generation
32
+ quantized_by: MaziyarPanahi
33
+ ---
34
+ # [MaziyarPanahi/T3qm7Strangemerges_32-7B-GGUF](https://huggingface.co/MaziyarPanahi/T3qm7Strangemerges_32-7B-GGUF)
35
+ - Model creator: [automerger](https://huggingface.co/automerger)
36
+ - Original model: [automerger/T3qm7Strangemerges_32-7B](https://huggingface.co/automerger/T3qm7Strangemerges_32-7B)
37
+
38
+ ## Description
39
+ [MaziyarPanahi/T3qm7Strangemerges_32-7B-GGUF](https://huggingface.co/MaziyarPanahi/T3qm7Strangemerges_32-7B-GGUF) contains GGUF format model files for [automerger/T3qm7Strangemerges_32-7B](https://huggingface.co/automerger/T3qm7Strangemerges_32-7B).
40
+
41
+ ### About GGUF
42
+
43
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
44
+
45
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
46
+
47
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
48
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
49
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
50
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
51
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
52
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
53
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
54
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
55
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
56
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
57
+
58
+ ## Special thanks
59
+
60
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
T3qm7Strangemerges_32-7B.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a62707b1017421e81ae12901df0cb1895ee0a81a93a736831e96723e507be1f
3
+ size 2719242080
T3qm7Strangemerges_32-7B.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21a751d2f9adf3d2ab5abf87443b1df04fea93eae1618313fe54b31c4d5b5d7d
3
+ size 3822024544
T3qm7Strangemerges_32-7B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f67befe7d9c894435e3bb65b3fb2ec1e943a43f2d0236a8926ec870e758f46d
3
+ size 3518986080
T3qm7Strangemerges_32-7B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:648e5bdc3571960a265fa6a9280be88331fb211bee45e7a2379470e763b6ff2e
3
+ size 3164567392
T3qm7Strangemerges_32-7B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b28393ebe329973bfa580c285dae375d9d36bcfb41fcf7d7883b892002461e88
3
+ size 4368439136
T3qm7Strangemerges_32-7B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c82476963b64cd11d7e6cc69bd64587ce7aca84f5e37505bb7d8ac66d31f4f1f
3
+ size 4140373856
T3qm7Strangemerges_32-7B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9af5c3797269fff4fac17be5c9177da74917c5d6800559c87371bab3cfa16bd9
3
+ size 5131409248
T3qm7Strangemerges_32-7B.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38a56c378389fa8cdc2b45a5354a19cca5f094af0408019625d1622bd355158f
3
+ size 4997715808
T3qm7Strangemerges_32-7B.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92a788f6b62bf6a3a8277a2d25ac3ea68b3d6a6b4100431643a50f3d821a2210
3
+ size 5942064992
T3qm7Strangemerges_32-7B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02d27c480d97e74ef7be6e7bcebea82d4ec74f4eda30999c4b12274a655ff337
3
+ size 7695857504
T3qm7Strangemerges_32-7B.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd934a3bd30bff4eaa6515b5575f52260d6f07e51d2e4446a7539d7b3560131a
3
+ size 14484731744