Hugging Face's logo

xaskasdf
/
llama-3.1-70b-instruct-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
llama-3.1-70b-instruct-gguf

Commit History

Upload llama-3.1-70b-instruct-q4_0.gguf
0f09659
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q5_k-00002-of-00002.gguf
ca6b841
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q5_k-00001-of-00002.gguf
32b036b
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q6_k-00002-of-00002.gguf
7df6c38
verified

xaskasdf commited on

Rename llama-3.1-instruct-70b.imatrix to llama-3.1-70b-instruct.imatrix
e59b0ab
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q6_k-00001-of-00002.gguf
0e662cc
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q8_0-00002-of-00002.gguf
25cb005
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q8_0-00001-of-00002.gguf
08163c6
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-f16-00003-of-00003.gguf
640d5a7
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-f16-00002-of-00003.gguf
9e1ffa5
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-f16-00001-of-00003.gguf
cd5eaa0
verified

xaskasdf commited on

Upload importance matrix (2 chunks at 100k tokens)
6f98bac
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-iq2_s.gguf
f2156a5
verified

xaskasdf commited on

Upload heavily quantized models
cb75023
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q5_0.gguf
05f120e
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q4_k.gguf
ed501da
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q3_k.gguf
64e2ad8
verified

xaskasdf commited on

Upload llama-3.1-70b-instruct-q2_k.gguf
48bf13b
verified

xaskasdf commited on

initial commit
f021622
verified

xaskasdf commited on