Hugging Face's logo

CISCai
/
Mistral-7B-Instruct-v0.3-SOTA-GGUF

Text Generation
GGUF
English
Inference Endpoints
imatrix
Model card Files Community
1
CISCai commited on
Commit
65803ed
•
1 Parent(s): aa9ae26

Added support for system prompt

Browse files
Files changed (12) hide show
  1. Mistral-7B-Instruct-v0.3.IQ1_M.gguf +2 -2
  2. Mistral-7B-Instruct-v0.3.IQ1_S.gguf +2 -2
  3. Mistral-7B-Instruct-v0.3.IQ2_M.gguf +2 -2
  4. Mistral-7B-Instruct-v0.3.IQ2_S.gguf +2 -2
  5. Mistral-7B-Instruct-v0.3.IQ2_XS.gguf +2 -2
  6. Mistral-7B-Instruct-v0.3.IQ2_XXS.gguf +2 -2
  7. Mistral-7B-Instruct-v0.3.IQ3_M.gguf +2 -2
  8. Mistral-7B-Instruct-v0.3.IQ3_S.gguf +2 -2
  9. Mistral-7B-Instruct-v0.3.IQ3_XS.gguf +2 -2
  10. Mistral-7B-Instruct-v0.3.IQ3_XXS.gguf +2 -2
  11. Mistral-7B-Instruct-v0.3.IQ4_XS.gguf +2 -2
  12. Mistral-7B-Instruct-v0.3.fp16.gguf +2 -2
Mistral-7B-Instruct-v0.3.IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b2d65cb3c1d02d1fae2b2a2eadf6a41cc5c98533dc15dea66a541eaa69393c59
3
- size 1757664096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d1a2dd797732b2bd81522c0dc2ce07f02c9a760f760e16302dda6477d1b7b59
3
+ size 1757664288
Mistral-7B-Instruct-v0.3.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dc9492b72a4b738eae124e4f3e54e68be4141d9bd0cd939524ab9acaa7433828
3
- size 1615319904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23a3cfd34d22263ccf49dfc02e7f3ea7c983118680a9dedca31817efdbd3efab
3
+ size 1615320096
Mistral-7B-Instruct-v0.3.IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:10c6cd4d8c5ea48a4ecdcbb6fd3e25f3947a7c541f90203564bfd2bf3c6427ba
3
- size 2504250208
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e93031a8c059e014a904b2f8cebdf073ff7310f9a6d2579c07c8d6ebdc6d8ae
3
+ size 2504250400
Mistral-7B-Instruct-v0.3.IQ2_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e3c35069f8e0d60bf8bb86ce7bcf295b1f8e4ed25f921362ee5116ccd98117c
3
- size 2314457952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2afeb6b4536c43014c5575aed66ce0577c965b9bf5019bc7c43cdbbaf520bc4a
3
+ size 2314458144
Mistral-7B-Instruct-v0.3.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:38c3feb885912c6d433dea57ddc9c9502576df460968552edfc22934196f0561
3
- size 2201473888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ff8d8d252da2955e69420ddf6ba79c7f9364c52a269d3333edefb6ca4e58bac
3
+ size 2201474080
Mistral-7B-Instruct-v0.3.IQ2_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c5b782d4e5e65ed0bcda50eb1566428952badf1c1460e4e0a58a05295bb6cba1
3
- size 1994904416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ebea120c9f96af5595fbb1b7addc8daa7841bfcf16703d0382d21b22e66a8e5
3
+ size 1994904608
Mistral-7B-Instruct-v0.3.IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:472e1279d1f929546d0ac17e1d94092a74bfa61893a79232b71f0d0b46290459
3
- size 3288847200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d49160a4dbf6af69ab8a22bcee90d821e724aa0deddd63c2625f60eaeff4af4
3
+ size 3288847392
Mistral-7B-Instruct-v0.3.IQ3_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7f0ec6ea42f4f2b1c36c794e5b82b6e44214e93dab966f99a3b9ad1e7e5fa822
3
- size 3186348896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:156cbd42ee5a635bb795dc36bd3283d7c746b2e12bfcd451163756a283345e0c
3
+ size 3186349088
Mistral-7B-Instruct-v0.3.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:228654d681e2339ac7b419056d75de460a0191815e72844f54fe893aa26073e3
3
- size 3022771040
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84985ba223dc145565068e1d1b617cc44201c46ad87b009c7281e708613bf484
3
+ size 3022771232
Mistral-7B-Instruct-v0.3.IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8a3c6fc31d093c4c068da8a8939a59e13e67c67136028dddd4ab44b1d396eb62
3
- size 2830881632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26233eb5e3fc54bbdfe977934ef7b015dd5dac759e424710f024fc795781027c
3
+ size 2830881824
Mistral-7B-Instruct-v0.3.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aa5ad02ed8f6f7531c75f81fd5eea88c7c5ddd749ec3b5a5d72900c08a2e28ea
3
- size 3911963488
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0afba232e1e46573db08bd965c82ef583f0b71131be840a19982339d94e067c
3
+ size 3911963680
Mistral-7B-Instruct-v0.3.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:117c7ce7495e69a13ae556c1814814d35f6d5025a0b2b9099931597eaa424b84
3
- size 14497337984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbd62e09c7201d790605d3a8be94260bfbecd70c470ed297e4d584fa319ed8ab
3
+ size 14497338144