mradermacher
/

llama3.1-kartoffeldes-70B-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

llama3.1-kartoffeldes-70B-i1-GGUF

1 contributor

History: 16 commits

mradermacher's picture

uploaded from rich1

3eeee42 verified 22 days ago

.gitattributes

2.66 kB

uploaded from rich1 22 days ago
README.md

244 Bytes

uploaded from rich1 22 days ago
imatrix.dat

24.9 MB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-IQ1_M.gguf

16.8 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-IQ2_M.gguf

24.1 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-IQ2_XXS.gguf

19.1 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-IQ3_M.gguf

31.9 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-IQ3_XXS.gguf

27.5 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-IQ4_XS.gguf

37.9 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-Q2_K.gguf

26.4 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-Q2_K_S.gguf

24.5 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-Q3_K_M.gguf

34.3 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-Q3_K_S.gguf

30.9 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-Q4_K_M.gguf

42.5 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-Q4_K_S.gguf

40.3 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-Q6_K.gguf.part1of2
29 GB
LFS

uploaded from rich1 22 days ago
llama3.1-kartoffeldes-70B.i1-Q6_K.gguf.part2of2
28.9 GB
LFS

uploaded from rich1 22 days ago