Introduce

Quantizing the shibing624/llama-3-8b-instruct-262k-chinese to f16, q2, q3, q4, q5, q6 and q8 with Llama.cpp.

Downloads last month
90
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including Monor/llama-3-8b-instruct-262k-chinese-gguf