Hugging Face's logo

MaziyarPanahi
/
calme-2.1-phi3.5-4b-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
1
MaziyarPanahi commited on
Commit
5577659
·
verified ·
1 Parent(s): 8dc8c98

Upload folder using huggingface_hub (#1)

Browse files

- 06a3c502801d3068804f025d874ee6ef3be6c370f387ad91f576c8098b3e33f9 (2e8e775bbe97232d5e6e02b6d6d0d85309c29f87)
- 96eaf83579115a3775afb7b1cd65ae22c4bf6582ee25073f41fd70bed120f04e (61c3d21066c284b43b09725fd08ca6194322aa69)
- eae02c205052319e15c15e4dc27b343e9bf8b43a68a7bdc1bedaee256a58d55f (da49ef91e858c3996ea27a41e63971e87ab5faa2)
- 772949e358d916ce0105c26600ade0e67b75a02090d009cdae8e4e434342537b (ed95da214b3fa7ad13bfcfe12194f19683a1534f)
- c6ae3eeac69e88d720ec399facd86bb6c101005f5ba8a81e189de41954709597 (138ca333ebfc1e8cbb902e3dfeeb1207738f0717)
- 9f436f811325b6f3a74560b141ae31dd20a8af662a813e8451a660a60a5b466d (5f16be9b0dd4f35e2e45ee01f7a58f6335079137)
- c33e504b8b9b7e282384b48f69dcad54fe237ad9ce63a1d63d86c2ba580c996a (b04a87b06e53cbc2e0da3268768096f1316b9e1d)
- cb8c19b22a947214c81ca588a124ea2dde4c80607f712a6beac3857903de4de7 (708c8c8feecb179d81d77c56981d624b57ecee09)
- 513b70ead096b47a864dcf0770d6c96e98c8e2ca264f537e15258136c6916012 (eb5ae0c22add8d5c9e03b993b15a1838bad3137a)
- dbf24a05cb5807a8694def581805b20fff503420776225e0e39afbbfd8bf0d50 (06c23bb76f5832d3d618c88b17066feb95f2bae0)
- fee17d80d0cb451bb132ce10c783ce953313f9b6f3e4bb0acca532701da9103e (68c4c47a60b670e4cf19c23b36b2906a841ea3dd)
- 21285a561b5fc00db2ed14d3099973520c3a1fcbb91f9d324c0249dc82887dfe (835067bf445e670a5d6e6a4eefa531f0d2547c18)
- 905673ce64f6cd0eeb4de160470dcf59762ba20facaf72cbf1f1dc0a6f6aba48 (8db340579f7de9cad4a9c85dc04d01e0590ebd6b)
- f75735ea2a7a027c5737fa0e9bc8aa9bb2503c2f6b2c286f01f8b987fb280914 (c1dc12d9f492b6a3bc3be932ef41c3edf3fe9443)

Files changed (18) hide show
  1. .gitattributes +16 -0
  2. README.md +46 -0
  3. calme-2.1-phi3.5-4b-GGUF_imatrix.dat +3 -0
  4. calme-2.1-phi3.5-4b.IQ1_M.gguf +3 -0
  5. calme-2.1-phi3.5-4b.IQ1_S.gguf +3 -0
  6. calme-2.1-phi3.5-4b.IQ2_XS.gguf +3 -0
  7. calme-2.1-phi3.5-4b.IQ3_XS.gguf +3 -0
  8. calme-2.1-phi3.5-4b.IQ4_XS.gguf +3 -0
  9. calme-2.1-phi3.5-4b.Q2_K.gguf +3 -0
  10. calme-2.1-phi3.5-4b.Q3_K_L.gguf +3 -0
  11. calme-2.1-phi3.5-4b.Q3_K_M.gguf +3 -0
  12. calme-2.1-phi3.5-4b.Q3_K_S.gguf +3 -0
  13. calme-2.1-phi3.5-4b.Q4_K_M.gguf +3 -0
  14. calme-2.1-phi3.5-4b.Q4_K_S.gguf +3 -0
  15. calme-2.1-phi3.5-4b.Q5_K_M.gguf +3 -0
  16. calme-2.1-phi3.5-4b.Q5_K_S.gguf +3 -0
  17. calme-2.1-phi3.5-4b.Q6_K.gguf +3 -0
  18. calme-2.1-phi3.5-4b.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,19 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ calme-2.1-phi3.5-4b-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ calme-2.1-phi3.5-4b.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ calme-2.1-phi3.5-4b.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ calme-2.1-phi3.5-4b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ calme-2.1-phi3.5-4b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ calme-2.1-phi3.5-4b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ calme-2.1-phi3.5-4b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
43
+ calme-2.1-phi3.5-4b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
44
+ calme-2.1-phi3.5-4b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ calme-2.1-phi3.5-4b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ calme-2.1-phi3.5-4b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
47
+ calme-2.1-phi3.5-4b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
48
+ calme-2.1-phi3.5-4b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
49
+ calme-2.1-phi3.5-4b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ calme-2.1-phi3.5-4b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
51
+ calme-2.1-phi3.5-4b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - text-generation
12
+ - text-generation
13
+ model_name: calme-2.1-phi3.5-4b-GGUF
14
+ base_model: MaziyarPanahi/calme-2.1-phi3.5-4b
15
+ inference: false
16
+ model_creator: MaziyarPanahi
17
+ pipeline_tag: text-generation
18
+ quantized_by: MaziyarPanahi
19
+ ---
20
+ # [MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF)
21
+ - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
22
+ - Original model: [MaziyarPanahi/calme-2.1-phi3.5-4b](https://huggingface.co/MaziyarPanahi/calme-2.1-phi3.5-4b)
23
+
24
+ ## Description
25
+ [MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF) contains GGUF format model files for [MaziyarPanahi/calme-2.1-phi3.5-4b](https://huggingface.co/MaziyarPanahi/calme-2.1-phi3.5-4b).
26
+
27
+ ### About GGUF
28
+
29
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
30
+
31
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
32
+
33
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
34
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
35
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
36
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
37
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
38
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
39
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
40
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
41
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
42
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
43
+
44
+ ## Special thanks
45
+
46
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
calme-2.1-phi3.5-4b-GGUF_imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e227d5821bd7ad594c2cd53812b9feaa048ee961b7f876c059a0adb2f1d2e92c
3
+ size 2232592
calme-2.1-phi3.5-4b.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c25561a1ffd3084ef42c65baa5d46dd3469fd966428dea62266dc574d556bc9e
3
+ size 917107808
calme-2.1-phi3.5-4b.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4e2070555fba4800069001eabc7137d3f8a368a6413c9cf9dda2cf01179cd67
3
+ size 841610336
calme-2.1-phi3.5-4b.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9081b1932ad4508bdb8b49c5eac86d5f300b5fdff298269896b4e02ee9fb517
3
+ size 1153037408
calme-2.1-phi3.5-4b.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4372c5838f759475a95656b13642a0b3c829586aeacfbd999821a58a113cfb37
3
+ size 1625176160
calme-2.1-phi3.5-4b.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:670a08bfc5834a8b4b1d76115c3c87b53815c7259024778acdd2a5a35a1e04a2
3
+ size 2059853408
calme-2.1-phi3.5-4b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d92d8f46ea3f52ff89da3edd7346130310d87b69a925d42c41d382d5c574119c
3
+ size 1416204896
calme-2.1-phi3.5-4b.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:904df30ce581deb2dd455516cd927e9264c6e6afd65964f0c276ee9a7c6d60a6
3
+ size 2087598176
calme-2.1-phi3.5-4b.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d854c5e4ab48ddce41a4b15eabc0474a8659d3ddeaa4ace33efe377702299b3
3
+ size 1955477600
calme-2.1-phi3.5-4b.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c07f56adbd6169a54d265d7bd750cbd123a3089745a927276a3338b95095045
3
+ size 1681799264
calme-2.1-phi3.5-4b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfe5123bb9455b8b2f95933d2aac7a12cf368504b8add928b92ac9984d98f543
3
+ size 2393232992
calme-2.1-phi3.5-4b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f4c9381b14d1303e15a818c445eaf606ff04bebf727efd0fb014428fda5447a
3
+ size 2188760672
calme-2.1-phi3.5-4b.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73dee917be89cf3f1b0b77b650ba314f65899732ae164fbd7233f1bd26bcfead
3
+ size 2815276640
calme-2.1-phi3.5-4b.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5851f7a8eb95bd8d7a94cd5d75376e971e91fe815da2ccddd25489e1bbaedff6
3
+ size 2641475168
calme-2.1-phi3.5-4b.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63048ec0f2513e1dc2a1e5fa5aa06177512e57b0d971cc30fa522c23ac375e40
3
+ size 3135853664
calme-2.1-phi3.5-4b.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddc9eb202bde279cbde547134fefbc4503b30835d512ceb5f9793d04a93ab533
3
+ size 4061223008