Hugging Face's logo

abhinand
/
tamil-llama-7b-base-v0.1

Text Generation
Transformers
PyTorch
Tamil
English
llama
text-generation-inference
Inference Endpoints
Model card Files Community
4

Are quantized GGML models available?

#1
by IndiaOutsource - opened
Discussion
IndiaOutsource

Are quantized GGML models available?

abhinand
 Owner

Hi @IndiaOutsource , I was also thinking about adding GGML and GGUF versions. I'll try to update the quantized versions soon, hopefully by tomorrow.

abhinand
 Owner
•
edited Nov 15, 2023

GGUF models have been added. Since GGUF is a replacement for GGML, GGML models won't be added!

Model Format Bits Download Links
Tamil LLaMA 7B Base GGUF Q4_K_M, Q5_K_M, Q8_0 HF Hub
Tamil LLaMA 13B Base GGUF Q4_K_M, Q5_K_M, Q8_0 HF Hub
Tamil LLaMA 7B Instruct GGUF Q4_K_M, Q5_K_M, Q8_0 HF Hub
Tamil LLaMA 13B Instruct GGUF Q4_K_M, Q5_K_M, Q8_0 HF Hub
abhinand changed discussion status to closed

Sign up or log in to comment