MaziyarPanahi/Inex12M7-7B-GGUF at refs/pr/1

Inex12M7-7B-GGUF

1 contributor

History: 13 commits

MaziyarPanahi's picture

c5c5e199bdcd342ca68e2875c62f5f5c043af210de67988fd69ec1567e096185

ba0e0d4 verified about 2 months ago

.gitattributes

2.17 kB

a1fade3c58f4d0e480d89c11432c0a328beb9ea4db2c00cc48b7acffe7d98cb7 about 2 months ago
Inex12M7-7B.Q2_K.gguf

2.72 GB
LFS

0cc1be1ad253f26af65ee3fb39af35cf71d65858377066515ef6b199d0327bca about 2 months ago
Inex12M7-7B.Q3_K_L.gguf

3.82 GB
LFS

486e0204101383633f155db6a6c88d11f7162d3b824dceed91d0f7c395c8639f about 2 months ago
Inex12M7-7B.Q3_K_M.gguf

3.52 GB
LFS

0644ce68213a7f7a156607a678fad67b7849c665596f4e25b4e3be806588744c about 2 months ago
Inex12M7-7B.Q3_K_S.gguf

3.16 GB
LFS

db3aa113052491490f1840dcd7edf38568799b26218fd6d86a961bf808787555 about 2 months ago
Inex12M7-7B.Q4_K_M.gguf
4.37 GB
LFS

cdc029be10a3e73c84180e9d1533ec68c22e089922fdf1a2f1159c0024e52d4a about 2 months ago
Inex12M7-7B.Q4_K_S.gguf

4.14 GB
LFS

3cc86de348fd3d0cbc70bceadc0936bdfce414ffb020a5e9513a06c8f6e47b6c about 2 months ago
Inex12M7-7B.Q5_K_M.gguf
5.13 GB
LFS

0c2a2fff3f397024601ed15e9413dbd70844b93b2cc085d97c15a809ef75fae2 about 2 months ago
Inex12M7-7B.Q5_K_S.gguf
5 GB
LFS

1cf8346b43f89b5d4e756db6eb67f985a735c8f379cb3736d0d8cc492b4c548b about 2 months ago
Inex12M7-7B.Q6_K.gguf
5.94 GB
LFS

8269b071554f8f31caee247de84f5636de2d03497680684051feb861889268f3 about 2 months ago
Inex12M7-7B.Q8_0.gguf
7.7 GB
LFS

a45f9258891fee97440cdeeef017ace2a162854e24bf27cb982ca9e9f2b651ee about 2 months ago
Inex12M7-7B.fp16.gguf
14.5 GB
LFS

a1fade3c58f4d0e480d89c11432c0a328beb9ea4db2c00cc48b7acffe7d98cb7 about 2 months ago
README.md

3.13 kB

c5c5e199bdcd342ca68e2875c62f5f5c043af210de67988fd69ec1567e096185 about 2 months ago