obrmmk/tinycodellama-1.3b-5k-GGUF

Quantized GGUF model files for tinycodellama-1.3b-5k from obrmmk

Name	Quant method	Size
tinycodellama-1.3b-5k.fp16.gguf	fp16	2.58 GB
tinycodellama-1.3b-5k.q2_k.gguf	q2_k	565.81 MB
tinycodellama-1.3b-5k.q3_k_m.gguf	q3_k_m	644.08 MB
tinycodellama-1.3b-5k.q4_k_m.gguf	q4_k_m	792.15 MB
tinycodellama-1.3b-5k.q5_k_m.gguf	q5_k_m	921.00 MB
tinycodellama-1.3b-5k.q6_k.gguf	q6_k	1.06 GB
tinycodellama-1.3b-5k.q8_0.gguf	q8_0	1.37 GB

Original Model Card: