MCZK
/

Vecteus-V2-7B-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Vecteus-V2-7B-GGUF

1 contributor

History: 13 commits

MCZK's picture

Upload Vecteus-V2-7B.iQ3_XS.gguf with huggingface_hub

586359e verified 5 months ago

.gitattributes

2.24 kB

Upload Vecteus-V2-7B.iQ3_XS.gguf with huggingface_hub 5 months ago
README.md

491 Bytes

Create README.md 5 months ago
Vecteus-V2-7B.Q3_K_M.iMatrix.gguf

3.52 GB
LFS

Upload Vecteus-V2-7B.Q3_K_M.iMatrix.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.Q4_K_M.iMatrix.gguf

4.37 GB
LFS

Upload Vecteus-V2-7B.Q4_K_M.iMatrix.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.Q5_K_M.iMatrix.gguf

5.13 GB
LFS

Upload Vecteus-V2-7B.Q5_K_M.iMatrix.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.Q5_K_S.iMatrix.gguf

5 GB
LFS

Upload Vecteus-V2-7B.Q5_K_S.iMatrix.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.Q6_K.iMatrix.gguf

5.94 GB
LFS

Upload Vecteus-V2-7B.Q6_K.iMatrix.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.Q8_0.gguf

7.7 GB
LFS

Upload Vecteus-V2-7B.Q8_0.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.iQ3_M.gguf

3.28 GB
LFS

Upload Vecteus-V2-7B.iQ3_M.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.iQ3_S.gguf

3.18 GB
LFS

Upload Vecteus-V2-7B.iQ3_S.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.iQ3_XS.gguf

3.02 GB
LFS

Upload Vecteus-V2-7B.iQ3_XS.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.iQ3_XXS.gguf

2.83 GB
LFS

Upload Vecteus-V2-7B.iQ3_XXS.gguf with huggingface_hub 5 months ago
Vecteus-V2-7B.iQ4_XS.gguf

3.91 GB
LFS

Upload Vecteus-V2-7B.iQ4_XS.gguf with huggingface_hub 5 months ago