MaziyarPanahi
/

calme-2.1-llama3.1-70b-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions Community

calme-2.1-llama3.1-70b-GGUF

1 contributor

History: 4 commits

MaziyarPanahi's picture

dbe56cba947ff528d3011a8e56899930afe145da7f4fd0a67e8747e056a412b2

80d68e3 verified 5 months ago

.gitattributes

2.16 kB

dbe56cba947ff528d3011a8e56899930afe145da7f4fd0a67e8747e056a412b2 5 months ago
calme-2.1-llama3.1-70b-GGUF_imatrix.dat

24.9 MB
LFS

Upload folder using huggingface_hub 5 months ago
calme-2.1-llama3.1-70b.IQ1_M.gguf

16.8 GB
LFS

Upload folder using huggingface_hub 5 months ago
calme-2.1-llama3.1-70b.IQ1_S.gguf

15.3 GB
LFS

Upload folder using huggingface_hub 5 months ago
calme-2.1-llama3.1-70b.IQ2_XS.gguf

21.1 GB
LFS

Upload folder using huggingface_hub 5 months ago
calme-2.1-llama3.1-70b.IQ3_XS.gguf

29.3 GB
LFS

Upload folder using huggingface_hub 5 months ago
calme-2.1-llama3.1-70b.IQ4_XS.gguf

37.9 GB
LFS

Upload folder using huggingface_hub 5 months ago
calme-2.1-llama3.1-70b.Q2_K.gguf

26.4 GB
LFS

Upload folder using huggingface_hub 5 months ago
calme-2.1-llama3.1-70b.Q3_K_L.gguf

37.1 GB
LFS

9601fa5f2b1135f1f5ba4a6a83e9b214ac0bb97e87bcf945c630887db381da03 5 months ago
calme-2.1-llama3.1-70b.Q3_K_M.gguf

34.3 GB
LFS

dbe56cba947ff528d3011a8e56899930afe145da7f4fd0a67e8747e056a412b2 5 months ago