DevQuasar
/

neuralmagic.Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

neuralmagic.Sparse-Llama-3.1-8B-2of4-GGUF

Commit History

Update README.md

2da2833
verified

csabakecskemeti commited on Dec 4, 2024

Upload neuralmagic.Sparse-Llama-3.1-8B-2of4.Q6_K.gguf with huggingface_hub

3a9e003
verified

csabakecskemeti commited on Nov 29, 2024

Upload neuralmagic.Sparse-Llama-3.1-8B-2of4.Q8_0.gguf with huggingface_hub

354d875
verified

csabakecskemeti commited on Nov 29, 2024

Upload neuralmagic.Sparse-Llama-3.1-8B-2of4.Q2_K.gguf with huggingface_hub

ec0ab7b
verified

csabakecskemeti commited on Nov 29, 2024

Upload neuralmagic.Sparse-Llama-3.1-8B-2of4.Q3_K_M.gguf with huggingface_hub

0bf08e8
verified

csabakecskemeti commited on Nov 29, 2024

Upload neuralmagic.Sparse-Llama-3.1-8B-2of4.Q5_K_M.gguf with huggingface_hub

ef5d58f
verified

csabakecskemeti commited on Nov 29, 2024

Upload neuralmagic.Sparse-Llama-3.1-8B-2of4.Q4_K_M.gguf with huggingface_hub

4e09d58
verified

csabakecskemeti commited on Nov 29, 2024

Upload README.md with huggingface_hub

0600eb3
verified

csabakecskemeti commited on Nov 29, 2024

initial commit

c821ba7
verified

csabakecskemeti commited on Nov 29, 2024