Hugging Face's logo

QuantFactory
/
KONI-Llama3-8B-Merged-20240724-GGUF

Text Generation
Transformers
GGUF
Inference Endpoints
conversational
Model card Files Community
Edit model card

QuantFactory/KONI-Llama3-8B-Merged-20240724-GGUF

This is quantized version of KISTI-KONI/KONI-Llama3-8B-Merged-20240724 created using llama.cpp

Original Model Card

Downloads last month
12
GGUF
Model size
8.03B params
Architecture
llama

4-bit

5-bit

6-bit

8-bit

Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.