bartowski
/

L3.1-MS-Astoria-70b-v2-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

L3.1-MS-Astoria-70b-v2-GGUF

1 contributor

History: 13 commits

bartowski's picture

Upload L3.1-MS-Astoria-70b-v2-IQ3_M.gguf with huggingface_hub

72b6b15 verified 4 months ago

L3.1-MS-Astoria-70b-v2-Q5_K_M
Upload folder using huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q6_K
Upload folder using huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q8_0
Upload folder using huggingface_hub 4 months ago
.gitattributes

2.84 kB

Upload L3.1-MS-Astoria-70b-v2-IQ3_M.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-IQ3_M.gguf

31.9 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-IQ3_M.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-IQ4_XS.gguf

37.9 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-IQ4_XS.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q3_K_L.gguf

37.1 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-Q3_K_L.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q3_K_M.gguf

34.3 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-Q3_K_M.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q3_K_XL.gguf

38.1 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-Q3_K_XL.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q4_0.gguf

40.1 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-Q4_0.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q4_K_M.gguf

42.5 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-Q4_K_M.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q4_K_S.gguf

40.3 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-Q4_K_S.gguf with huggingface_hub 4 months ago
L3.1-MS-Astoria-70b-v2-Q5_K_S.gguf

48.7 GB
LFS

Upload L3.1-MS-Astoria-70b-v2-Q5_K_S.gguf with huggingface_hub 4 months ago