MaziyarPanahi commited on
Commit
b1d3558
1 Parent(s): f730d53

Upload folder using huggingface_hub (#1)

Browse files

- 860467a1a48439e9237907bab626aa288f143fb66bb0553fb7914518563c5875 (aae7238e333b5a5b92a089b0529e1e9db9ddf468)
- 2cba399ab0bfd1da253fccb7fff187dc8f56319fb109a89c385666aa89ec2ae4 (5cddffa51f36edd07eafd4dd8df2e9c44e5f1851)
- d55b41333435c1b1ff7fb8e269a9c77a130a841ba5223094f7f371cfe4eed466 (6b430d243584507561b895c18faa1c9ac0dadea1)
- 503374d5031f3aabf2dc94746d279362da5da9129466d6318b6a9ca46c4c62db (493e1a2749a88fa28176df231aca220a176e1228)
- c33b398c8f61c08627d3d82a2294d77bd444881fac0d406ba82c26647d5c671e (72b0acc08123c47014cb8597092919114894c995)
- ee7a7b1ae2599341ef001a89c26880067e10771c477afeed4b987c098a6fb98c (b7e495811c056e33da9898e76b1a63e9a5edbb64)
- b31cf36a6a5a2dbca1f47306aa95eff318534c534a7f31247b2247eb85f4ae44 (57c8c7a19c68026edb6b50719451e69761cd11d4)
- 9106f3efa161673b01ce605552ca8d8da329ecec2bbea166b9d93a2999d432ca (b2c4dcd659844846dc52b48a4bc0e488c267cd10)
- f96b5a53198392571ae0bf59121a0e42bc2bb1c5fd6bceeb74f2a146b87e1c02 (38344a0cf5224880bb047ed4c67172f2662448d1)
- 4b9f71a5ee21108634a750d0d2d6ee181023307c92d4821d2963f688fe8a6c64 (7f877f67a95e1ef8768f162f57518636bf1b2b5b)
- fcf2acc92602caf48f6dfec9edf41138c82a7541e1c97eeff4e9d663c4d5566a (0142e0796643d7a49b97ace9ff59f93f65046773)

.gitattributes CHANGED
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ TopStarClaudioArena.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ TopStarClaudioArena.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ TopStarClaudioArena.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ TopStarClaudioArena.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ TopStarClaudioArena.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ TopStarClaudioArena.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ TopStarClaudioArena.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ TopStarClaudioArena.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ TopStarClaudioArena.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ TopStarClaudioArena.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - transformers
12
+ - safetensors
13
+ - mistral
14
+ - text-generation
15
+ - mergekit
16
+ - merge
17
+ - base_model:NousResearch/Hermes-2-Theta-Llama-3-8B
18
+ - base_model:mergekit-community/mergekit-slerp-ebgdloh
19
+ - autotrain_compatible
20
+ - endpoints_compatible
21
+ - text-generation-inference
22
+ - region:us
23
+ - text-generation
24
+ model_name: TopStarClaudioArena-GGUF
25
+ base_model: mergekit-community/TopStarClaudioArena
26
+ inference: false
27
+ model_creator: mergekit-community
28
+ pipeline_tag: text-generation
29
+ quantized_by: MaziyarPanahi
30
+ ---
31
+ # [MaziyarPanahi/TopStarClaudioArena-GGUF](https://huggingface.co/MaziyarPanahi/TopStarClaudioArena-GGUF)
32
+ - Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
33
+ - Original model: [mergekit-community/TopStarClaudioArena](https://huggingface.co/mergekit-community/TopStarClaudioArena)
34
+
35
+ ## Description
36
+ [MaziyarPanahi/TopStarClaudioArena-GGUF](https://huggingface.co/MaziyarPanahi/TopStarClaudioArena-GGUF) contains GGUF format model files for [mergekit-community/TopStarClaudioArena](https://huggingface.co/mergekit-community/TopStarClaudioArena).
37
+
38
+ ### About GGUF
39
+
40
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
41
+
42
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
43
+
44
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
45
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
46
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
47
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
48
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
49
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
50
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
51
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
52
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
53
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
54
+
55
+ ## Special thanks
56
+
57
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
TopStarClaudioArena.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:358cef1e922e79294ec1692fa51a8ba7df43a6cee6d12354ba2d8333cc18f2e2
3
+ size 2719242080
TopStarClaudioArena.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87a9307ad2d6ea15b39b3002b0314ce5b6f504507f88a6f2f56fe3333ecac767
3
+ size 3822024544
TopStarClaudioArena.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e70fa28f9fa97343fb537f2c5420b68364be319d388eeb81394508e952e1c23c
3
+ size 3518986080
TopStarClaudioArena.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24170cb8215f76bf1a82e0159289f915041f8428a53c440fe7fbb287541e7f92
3
+ size 3164567392
TopStarClaudioArena.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bd107173ae2ee224b04742ad36df724b6406ecfcd48257265eeb74e715488d6
3
+ size 4368439136
TopStarClaudioArena.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:549b254ae53cfabf38960b727eb8d96e882179e63a6632ed739ed38512bb2f0e
3
+ size 4140373856
TopStarClaudioArena.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73f360d670e059fa3be702834c7b422d276e0d01d99400f31c066f1d45c54941
3
+ size 5131409248
TopStarClaudioArena.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f489309e16f840fc5323003fc05758e2df024d464266b34d4adea3fcfc54ed1
3
+ size 4997715808
TopStarClaudioArena.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56e4969f9f1a74ab88e2f64e855216df223ed4cb3a855c8cace73152fcb96f50
3
+ size 5942064992
TopStarClaudioArena.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52e0494cfbb556f5939537bcc4eccf27352106268de5f46f473dfb1a8fb6929b
3
+ size 7695857504