Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation
GGUF
5 languages
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
Model card Files Community
37
MaziyarPanahi commited on
Commit
4730e5a
•
1 Parent(s): 34e5fb4

Upload folder using huggingface_hub (#4)

Browse files

- 2cd74a63d48f001cadccde71afabe6914c6fcf914c00a5e7c0d616195d74415f (8fa2d25102d0721aa1c1528101bfa2580436b340)
- 3d53c4dec30b5005b22b61a40b213e12bd35149d2dd0820523bb9f2be4f2eadc (3482aa58fd8a3f8fd617ae5eaa5bf216ff061e82)
- 24c0f8bfd14dea30d867b68b8528dfaaf470417b5509ef314bfd8c00157c396b (208307409d0509f48da6ce8d45e2ed2ee2305053)
- 477ab7b61e0e03cfcc7c9b231a7f1e00c94291a95b085dd8b89d0945583d9804 (2edd8eaa2c321a66b7a4e9b6d97eaf77b2ed691e)
- 25bc2be9af1678bb0fbaa54fa3634b57032a497ee5f8093f72f53984b7a2acbd (dfbef2e8b04f3aaff011cf244f12501482b23a89)

Files changed (6) hide show
  1. .gitattributes +5 -0
  2. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00005.gguf +3 -0
  3. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00005.gguf +3 -0
  4. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00005.gguf +3 -0
  5. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00004-of-00005.gguf +3 -0
  6. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,8 @@ Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=l
38
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
38
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb42717e65dab202e4967291c7c4bdfe617f96ee1cc2d1b0cbd7e3865c365abf
3
+ size 13522070848
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e205cad17292dbdd048f15c74d3ff3d13551c23cd8de2695f038f76efca1d78f
3
+ size 13193535648
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff9c38e8ebcc2aa118fc3a9e90487372687e64ee4ae2d0a1787f9167204eb8e0
3
+ size 12560359552
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:709918b6cc4b076086d03e943be1e6d149fad7a1962c6f6ff39b9931e5e7a3f7
3
+ size 13347381408
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5c99bb6440fdd473f06e8f9cb22ef1742a3b0202d4affa8dbe0d4b0372c9b41
3
+ size 5610777920