Hugging Face's logo

MaoyueOUO
/
mistral-nemo-minitron-8b-instruct-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
MaoyueOUO commited on
Commit
cd2f42b
•
1 Parent(s): f5cd780

Upload 8 files

Browse files
Files changed (9) hide show
  1. .gitattributes +8 -0
  2. Mistral-NeMo-Minitron-8B-Instruct-Q2_K.gguf +3 -0
  3. Mistral-NeMo-Minitron-8B-Instruct-Q3_K_L.gguf +3 -0
  4. Mistral-NeMo-Minitron-8B-Instruct-Q3_K_M.gguf +3 -0
  5. Mistral-NeMo-Minitron-8B-Instruct-Q3_K_S.gguf +3 -0
  6. Mistral-NeMo-Minitron-8B-Instruct-Q4_1.gguf +3 -0
  7. Mistral-NeMo-Minitron-8B-Instruct-Q4_K_S.gguf +3 -0
  8. Mistral-NeMo-Minitron-8B-Instruct-Q4_k_M.gguf +3 -0
  9. Mistral-NeMo-Minitron-8B-Instruct-Q5_k_S.gguf +3 -0
.gitattributes CHANGED
@@ -35,3 +35,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Mistral-NeMo-Minitron-8B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
  Mistral-NeMo-Minitron-8B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Mistral-NeMo-Minitron-8B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
  Mistral-NeMo-Minitron-8B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Mistral-NeMo-Minitron-8B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Mistral-NeMo-Minitron-8B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mistral-NeMo-Minitron-8B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mistral-NeMo-Minitron-8B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mistral-NeMo-Minitron-8B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mistral-NeMo-Minitron-8B-Instruct-Q4_k_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mistral-NeMo-Minitron-8B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mistral-NeMo-Minitron-8B-Instruct-Q5_k_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-NeMo-Minitron-8B-Instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03009921b30ea0176440a3db7ad16b529bd924b643874c5cc6775a1d6be03a92
3
+ size 3333391776
Mistral-NeMo-Minitron-8B-Instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a49434ab829ca43f2972d62719e542ebaf7f3d9527336785f0089e49a834897f
3
+ size 4537091488
Mistral-NeMo-Minitron-8B-Instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:219406c558704de47d60281fe11f13de799ebf5ead7d03709b6c58c6146e1e9a
3
+ size 4209149344
Mistral-NeMo-Minitron-8B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8d610be8d4175748cdd07788793185657bfa0486e283e2da7b53d06a4067d2e
3
+ size 3834217888
Mistral-NeMo-Minitron-8B-Instruct-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d552a40dda4c962f4883441789c18515291e477eed681b09739252810024638
3
+ size 5372675488
Mistral-NeMo-Minitron-8B-Instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f11fe49b621de50154c72118aedf4018034c799326774985a8a5400c2852f194
3
+ size 4911957408
Mistral-NeMo-Minitron-8B-Instruct-Q4_k_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:746e52dc30d865b8a43f0b28c8d6248a2b15af9349c502017b36a7da5f5c6b55
3
+ size 5145298336
Mistral-NeMo-Minitron-8B-Instruct-Q5_k_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38af00f5deff6ccf36dc20f0ceee8e07a8f1b79c416aaffe180d88b897f54f2c
3
+ size 5864981920