bartowski
/

Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Meta-Llama-3.1-70B-Instruct-GGUF

Ctrl+K

Ctrl+K

2 contributors

History: 23 commits

bartowski's picture

Upload folder using huggingface_hub

7c21c9f verified 10 months ago

Meta-Llama-3.1-70B-Instruct-Q5_K_L
Upload folder using huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q5_K_M
Upload folder using huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q6_K
Upload folder using huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q6_K_L
Upload folder using huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q8_0
Upload folder using huggingface_hub 10 months ago
.gitattributes

3.59 kB

Upload Meta-Llama-3.1-70B-Instruct.imatrix with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-IQ2_M.gguf

24.1 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-IQ2_M.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-IQ3_M.gguf

31.9 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-IQ3_M.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-IQ3_XS.gguf

29.3 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-IQ3_XS.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf

37.9 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q2_K.gguf

26.4 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-Q2_K.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q2_K_L.gguf

27.4 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-Q2_K_L.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf

30.9 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q4_K_L.gguf

43.3 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-Q4_K_L.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf

42.5 GB
xet

Upload Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf with huggingface_hub 10 months ago
Meta-Llama-3.1-70B-Instruct.imatrix

24.9 MB
xet

Upload Meta-Llama-3.1-70B-Instruct.imatrix with huggingface_hub 10 months ago
README.md

21.1 kB

Update README.md 10 months ago