Limour
/

Qwen2.5-14B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

https://www.kaggle.com/code/reginliu/qwen2-5-gguf-imatrix

Model	Size	PPL	n_vocab	PPL_adjust
qwen2.5-14b-fp16.gguf	27.51	9.5316 +/- 0.08886	152064	9.5316
qwen2.5-14b-IQ4_XS.gguf	7.56	9.6508 +/- 0.09039	152064	9.6508

Downloads last month: 8

GGUF

Model size

14.8B params

Architecture

qwen2

4-bit

Inference API

Unable to determine this model's library. Check the docs .