Hugging Face's logo

prithivMLmods
/
Qwen2.5-Coder-3B-GGUF

Text Generation
Transformers
GGUF
English
Qwen
2.5
Coder
F16
16-bit
Q4
Q5
Q8
Llama-cpp
Inference Endpoints
conversational
Model card Files Community
prithivMLmods commited on
Commit
5aaed2d
•
1 Parent(s): d0b1255

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Qwen2.5-Coder-3B.F16.gguf +3 -0
  3. Qwen2.5-Coder-3B.Q4_K_M.gguf +3 -0
  4. Qwen2.5-Coder-3B.Q5_K_M.gguf +3 -0
  5. Qwen2.5-Coder-3B.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen2.5-Coder-3B.F16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwen2.5-Coder-3B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen2.5-Coder-3B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen2.5-Coder-3B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Coder-3B.F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecd2bd21870d32716e70283da37a3cdc3ecebbb3a5b402313d06271578f9a9c1
3
+ size 6178316608
Qwen2.5-Coder-3B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:103a3893057a6ad794c00cd38ab6ce8c3b9b88e9403ee8d8ec3adf561cdbb30a
3
+ size 1929902400
Qwen2.5-Coder-3B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91458254ecabf3c971ccecf430239b64e6f9f19e125442a7b7de2baab97a94d3
3
+ size 2224814400
Qwen2.5-Coder-3B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d346e4c6291bd9d9674aec198c7646322d0a26ff262305858c9ed269613f3666
3
+ size 3285475648