Upload folder using huggingface_hub (#1)
Browse files- 7dedacd34db0a3c15033a74fefd5ec36fd34dc96ce1ae0de71f306f8ebc6e647 (9df4fe2519d9a3bbde4cd44b24d79421cda3d08a)
- 17b81e277b39addf5a3fcacac60bce1d6ec0cf5100da2f4e09dd6936499cb3fc (8631659936c686d6c276c1b0dcedd035dd6c036f)
- 67b7676113ea48331acf25ce6ec9c65b35528506ea6d8c298b1c7492e5faf003 (a8fd307e3eb4668304e6c5ee5307538954ad7875)
- cfe8611e7925fc9a982e205610faa818655c1654f5d4081dda4c941b3c21fdac (885d7b79ddc4bfc8571f95ee5ebf5436ed9925d2)
- 5d250044a6e984f26408c145215e1b81a1ca16d9dfbd20cdcaa7ef2a80733905 (5e8f8b2d6ed4756e2868d641a26df60b45e4952e)
- 3d13a5123ef328a7f0e43bd9377e31cefc4b2084725ad938186a2bc797433d6e (fd2d2f995c525d53b3b53f358185b02773ffcda1)
- bdb363f32de7b0b23fa3934b9f902e988a29f93a3786dc92ea84ee6a55b4091b (0e76f5960238208a69ccb50e88ffee836bc1b7a0)
- 71fe37113c7386297593c0d3eb89b1dc7e3d5e6a24bf880418dc5978a2ecd61e (e2f7cfcf1d0c1d7ba46dcd78a3a4b236103f6258)
- d742f6da0837d305cd73c1a0adac8679c0805c2f4708771962087a7472bc4888 (4a761209b1e54547d04d7cac3225e16c503ea322)
- 6c376b7dafdfe424168fa4266ed7bbecbe75d77789a2a8d60c0f3f685ece46d0 (718a84960e161b5b6cd0ab460eaaf1dbf26e2982)
- a388151facb82a2e093ccb4868cccbeddb73afdc48b623082628460622f625eb (c46b2284a9dd3552fa520364f855ec6198d313be)
- .gitattributes +10 -0
- README.md +58 -0
- mergekit-slerp-rxkhjnf.Q2_K.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q3_K_L.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q3_K_M.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q3_K_S.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q4_K_M.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q4_K_S.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q5_K_M.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q5_K_S.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q6_K.gguf +3 -0
- mergekit-slerp-rxkhjnf.Q8_0.gguf +3 -0
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
mergekit-slerp-rxkhjnf.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
mergekit-slerp-rxkhjnf.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
mergekit-slerp-rxkhjnf.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
mergekit-slerp-rxkhjnf.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
40 |
+
mergekit-slerp-rxkhjnf.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
41 |
+
mergekit-slerp-rxkhjnf.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
42 |
+
mergekit-slerp-rxkhjnf.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
43 |
+
mergekit-slerp-rxkhjnf.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
44 |
+
mergekit-slerp-rxkhjnf.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
45 |
+
mergekit-slerp-rxkhjnf.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- quantized
|
4 |
+
- 2-bit
|
5 |
+
- 3-bit
|
6 |
+
- 4-bit
|
7 |
+
- 5-bit
|
8 |
+
- 6-bit
|
9 |
+
- 8-bit
|
10 |
+
- GGUF
|
11 |
+
- transformers
|
12 |
+
- safetensors
|
13 |
+
- llama
|
14 |
+
- text-generation
|
15 |
+
- mergekit
|
16 |
+
- merge
|
17 |
+
- conversational
|
18 |
+
- base_model:NousResearch/Meta-Llama-3-8B-Instruct
|
19 |
+
- base_model:cognitivecomputations/dolphin-2.8-mistral-7b-v02
|
20 |
+
- autotrain_compatible
|
21 |
+
- endpoints_compatible
|
22 |
+
- text-generation-inference
|
23 |
+
- region:us
|
24 |
+
- text-generation
|
25 |
+
model_name: mergekit-slerp-rxkhjnf-GGUF
|
26 |
+
base_model: mergekit-community/mergekit-slerp-rxkhjnf
|
27 |
+
inference: false
|
28 |
+
model_creator: mergekit-community
|
29 |
+
pipeline_tag: text-generation
|
30 |
+
quantized_by: MaziyarPanahi
|
31 |
+
---
|
32 |
+
# [MaziyarPanahi/mergekit-slerp-rxkhjnf-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-slerp-rxkhjnf-GGUF)
|
33 |
+
- Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
|
34 |
+
- Original model: [mergekit-community/mergekit-slerp-rxkhjnf](https://huggingface.co/mergekit-community/mergekit-slerp-rxkhjnf)
|
35 |
+
|
36 |
+
## Description
|
37 |
+
[MaziyarPanahi/mergekit-slerp-rxkhjnf-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-slerp-rxkhjnf-GGUF) contains GGUF format model files for [mergekit-community/mergekit-slerp-rxkhjnf](https://huggingface.co/mergekit-community/mergekit-slerp-rxkhjnf).
|
38 |
+
|
39 |
+
### About GGUF
|
40 |
+
|
41 |
+
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
|
42 |
+
|
43 |
+
Here is an incomplete list of clients and libraries that are known to support GGUF:
|
44 |
+
|
45 |
+
* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
|
46 |
+
* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
|
47 |
+
* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
|
48 |
+
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
|
49 |
+
* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
|
50 |
+
* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
|
51 |
+
* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
|
52 |
+
* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
|
53 |
+
* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
|
54 |
+
* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
|
55 |
+
|
56 |
+
## Special thanks
|
57 |
+
|
58 |
+
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:dde3dc5a4ec3c9fa945c611e95afc0874048d9695ad059449c953151e419d21a
|
3 |
+
size 2726352480
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6d4c0c5b7cb3def362a6be9792118513d4fe37774819de088e95a8a30d9f884d
|
3 |
+
size 3829135776
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b1766c7f9d53346213d3eaf44b4314acfce31fe85455c1d2f2111826124018fe
|
3 |
+
size 3526097312
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4a655bd1fc5b59a02e8cf1014c3473dd9995252e6441d0b5f2dc7185d4788fd8
|
3 |
+
size 3171678624
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d0ffd0a097d9db8347e7c6b7bf7fa7b3f3b88bc2f92a9d64e470035640e00a48
|
3 |
+
size 4375551456
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:39820b87ee041b3facc332d3feb174201d5e43466705216debedecae97b7de00
|
3 |
+
size 4147486176
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:dc7bc8efff0989161fffce2e32823691203021bf3b0a39cb761df0d927d6651c
|
3 |
+
size 5138522592
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:413ca637c7db08c76ec1104cbe8c48b293a5374b7072deb072865759e37ab4de
|
3 |
+
size 5004829152
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:40db323f76dad9e9fe22acf56052e5bdee806b0364b7b761ec113b543d67617a
|
3 |
+
size 5949179424
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1266a18aa475a036556c0f7bd0c4eff20db5a36207e287df7b469433e1661020
|
3 |
+
size 7702975904
|