leafspark
/

Llama-3-8B-Instruct-Gradient-4194k-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-3-8B-Instruct-Gradient-4194k-GGUF / .gitattributes

Commit History

Add IQ1_S quant

e0400b4
verified

leafspark commited on May 9

Add IQ3_S quant

3c1daf1
verified

leafspark commited on May 9

Upload llama-3-8b-instruct-gradient-4194k.f16.gguf

afc450d
verified

leafspark commited on May 9

Upload llama-3-8b-instruct-gradient-4194k.IQ2_XS.gguf

75b672e
verified

leafspark commited on May 9

Upload Llama-3-8B-Instruct-Gradient-4194k.Q4_K_M.fixed.gguf

f0acc9b
verified

leafspark commited on May 9

Upload llama-3-8b-instruct-gradient-4194k.IQ4_XS.gguf

fb7130e
verified

leafspark commited on May 8

Upload imatrix.dat

505e651
verified

leafspark commited on May 8

Add extra Q4 quants

a892621
verified

leafspark commited on May 8

Add Q3_K_L quant

4437973
verified

leafspark commited on May 8

Add S quants

d66dd33
verified

leafspark commited on May 8

Add Q2_K quant

f5e6e7a
verified

leafspark commited on May 8

Add Q3 and Q5 quants

01006e4
verified

leafspark commited on May 8

Add Q4_K_M quant

0e22f24
verified

leafspark commited on May 8

Upload llama-3-8b-instruct-gradient-4194k.Q6_K.gguf

9a4f822
verified

leafspark commited on May 8

Upload llama-3-8b-instruct-gradient-4194k.Q8_0.gguf with huggingface_hub

84f4367
verified

leafspark commited on May 8

initial commit

d906329
verified

leafspark commited on May 8