Hugging Face's logo

featherless-ai-quants
/
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
m8than commited on
Commit
992da4b
·
verified ·
1 Parent(s): 61bcd93

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +104 -0
  2. README.md +47 -0
  3. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00001-of-00008.gguf +3 -0
  4. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00002-of-00008.gguf +3 -0
  5. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00003-of-00008.gguf +3 -0
  6. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00004-of-00008.gguf +3 -0
  7. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00005-of-00008.gguf +3 -0
  8. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00006-of-00008.gguf +3 -0
  9. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00007-of-00008.gguf +3 -0
  10. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00008-of-00008.gguf +3 -0
  11. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00001-of-00006.gguf +3 -0
  12. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00002-of-00006.gguf +3 -0
  13. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00003-of-00006.gguf +3 -0
  14. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00004-of-00006.gguf +3 -0
  15. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00005-of-00006.gguf +3 -0
  16. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00006-of-00006.gguf +3 -0
  17. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00001-of-00008.gguf +3 -0
  18. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00002-of-00008.gguf +3 -0
  19. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00003-of-00008.gguf +3 -0
  20. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00004-of-00008.gguf +3 -0
  21. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00005-of-00008.gguf +3 -0
  22. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00006-of-00008.gguf +3 -0
  23. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00007-of-00008.gguf +3 -0
  24. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00008-of-00008.gguf +3 -0
  25. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00001-of-00007.gguf +3 -0
  26. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00002-of-00007.gguf +3 -0
  27. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00003-of-00007.gguf +3 -0
  28. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00004-of-00007.gguf +3 -0
  29. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00005-of-00007.gguf +3 -0
  30. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00006-of-00007.gguf +3 -0
  31. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00007-of-00007.gguf +3 -0
  32. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00001-of-00007.gguf +3 -0
  33. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00002-of-00007.gguf +3 -0
  34. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00003-of-00007.gguf +3 -0
  35. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00004-of-00007.gguf +3 -0
  36. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00005-of-00007.gguf +3 -0
  37. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00006-of-00007.gguf +3 -0
  38. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00007-of-00007.gguf +3 -0
  39. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00001-of-00009.gguf +3 -0
  40. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00002-of-00009.gguf +3 -0
  41. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00003-of-00009.gguf +3 -0
  42. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00004-of-00009.gguf +3 -0
  43. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00005-of-00009.gguf +3 -0
  44. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00006-of-00009.gguf +3 -0
  45. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00007-of-00009.gguf +3 -0
  46. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00008-of-00009.gguf +3 -0
  47. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00009-of-00009.gguf +3 -0
  48. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00001-of-00009.gguf +3 -0
  49. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00002-of-00009.gguf +3 -0
  50. deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00003-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,107 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
37
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
38
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
39
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
40
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
41
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
42
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
43
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
44
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
45
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
46
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
47
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
48
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
49
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
50
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
51
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
52
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
53
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
54
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
55
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
56
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
57
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
58
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
59
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
60
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
61
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
62
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
63
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
64
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
65
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
66
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
67
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
68
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
69
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
70
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
71
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
72
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
73
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
74
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
75
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
76
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
77
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
78
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
79
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
80
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
81
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
82
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
83
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
84
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
85
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
86
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
87
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
88
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
89
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
90
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00001-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
91
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00002-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
92
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00003-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
93
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00004-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
94
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00005-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
95
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00006-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
96
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00007-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
97
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00008-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
98
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00009-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
99
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00010-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
100
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M-00011-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
101
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00001-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
102
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00002-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
103
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00003-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
104
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00004-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
105
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00005-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
106
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00006-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
107
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00007-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
108
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
109
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
110
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
111
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00001-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
112
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00002-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
113
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00003-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
114
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00004-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
115
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00005-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
116
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00006-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
117
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00007-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
118
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00008-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
119
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00009-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
120
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00010-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
121
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00011-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
122
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K-00012-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
123
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00001-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
124
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00002-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
125
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00003-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
126
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00004-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
127
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00005-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
128
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00006-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
129
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00007-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
130
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00008-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
131
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00009-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
132
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00010-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
133
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00011-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
134
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00012-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
135
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00013-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
136
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00014-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
137
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00015-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
138
+ deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0-00016-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
139
+ featherless-quants.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: deepseek-ai/DeepSeek-R1-Distill-Llama-70B
3
+ pipeline_tag: text-generation
4
+ quantized_by: featherless-ai-quants
5
+ ---
6
+
7
+ # deepseek-ai/DeepSeek-R1-Distill-Llama-70B GGUF Quantizations 🚀
8
+
9
+ ![Featherless AI Quants](./featherless-quants.png)
10
+
11
+ *Optimized GGUF quantization files for enhanced model performance*
12
+
13
+ > Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
14
+ ---
15
+
16
+ ## Available Quantizations 📊
17
+
18
+ | Quantization Type | File | Size |
19
+ |-------------------|------|------|
20
+ | IQ4_XS | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS) | 36496.80 MB (folder) |
21
+ | Q2_K | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K) | 25153.27 MB (folder) |
22
+ | Q3_K_L | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L) | 35420.03 MB (folder) |
23
+ | Q3_K_M | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M) | 32680.03 MB (folder) |
24
+ | Q3_K_S | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S) | 29480.03 MB (folder) |
25
+ | Q4_K_M | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M) | 40550.61 MB (folder) |
26
+ | Q4_K_S | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S) | 38478.11 MB (folder) |
27
+ | Q5_K_M | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_M) | 47635.86 MB (folder) |
28
+ | Q5_K_S | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q5_K_S) | 46403.36 MB (folder) |
29
+ | Q6_K | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q6_K) | 55206.44 MB (folder) |
30
+ | Q8_0 | [deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0](https://huggingface.co/featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF/tree/main/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q8_0) | 71501.78 MB (folder) |
31
+
32
+
33
+ ---
34
+
35
+ ## ⚡ Powered by [Featherless AI](https://featherless.ai)
36
+
37
+ ### Key Features
38
+
39
+ - 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
40
+ - 🛠️ **Zero Infrastructure** - No server setup or maintenance required
41
+ - 📚 **Vast Compatibility** - Support for 2400+ models and counting
42
+ - 💎 **Affordable Pricing** - Starting at just $10/month
43
+
44
+ ---
45
+
46
+ **Links:**
47
+ [Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:174dc555ffa436bb01f4c97efbdb38f559d05727b0a9d771a03bc8f393defb06
3
+ size 4999703104
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:666a3dbac0bb2964b3a3e880c3a6b788619e50b0f78085e87971f17b54336ace
3
+ size 4974909152
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcf0a1bf0fc2727eb07f4e178e908547ada5a96af477fa386b24e49dd950f554
3
+ size 4886009568
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01272965c374908488b45ef0ae6e442349ca2e202cd98d73a3d2483827c0cce6
3
+ size 4890498912
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d622d02ad292221f494190980ca911e89cb32036894fc4789e284dd855eda7c7
3
+ size 4890498912
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5db9c105c29c3af1bb69a7cb351250aa56fad972a05329dfe153a69733a209ac
3
+ size 4973827808
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57bff7243a1182110f161a64854a250acb562be9fe82fbc99904b68a6af5be04
3
+ size 4979627872
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-IQ4_XS-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cff2e4ce37dadc9e0f89d069101cab63c625ee14eb0d0096e2b98a57d454214a
3
+ size 3674590784
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49934ffaace12e8a8659b74de7d44f455f54de8fdbca9cbe8cc96a5da9852c44
3
+ size 4933711200
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3131bb22f53e551ce74f435607f22633de9ab8a2c275caf9c6ff6ee3b14bacd
3
+ size 4955054560
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:324d4ce5e5f895fea57fd6481385dd5fc0b6c458192a6579ff2c538c04852844
3
+ size 4931199456
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f40a420956d1af31346dc78b3a3ab41d471be775b2349137dc8f99ab47e69303
3
+ size 4975468832
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c6b207e7551f88b1abd4e0975af8c14a1b2c970441c26f61f9c578f3b5f837a
3
+ size 4167244992
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q2_K-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f7ac48997531ffc8a2989611e8f133112ccebac772070f28f3ee4ac1c991639
3
+ size 2412432160
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d88d5f998ad0ca4a3117b4de114ef2c6cf55a27372c0caa4258c62579414fbd
3
+ size 4936739968
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0ddda2aa1830fd36ca143b5af11e0b5f825c1c8a8b143f26babe7418fb19e3e
3
+ size 4925167520
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7c848e5fa53d9d864d7aaf5d1598f1256af56be9d32cd19858ea3e9a5859b81
3
+ size 4925167520
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ad9db14e213a958c915e394304d764556e90919d491a318c9e5dcda2ad40706
3
+ size 4925167520
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e371344d18fc83288ae17741d9cc23da8895e35bccfb1e6e0a05ff7ef2eb7f1
3
+ size 4925167520
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:610ff764c979374070a7389b53617bfa32650d9068dce24ae25b4f4ac739dd08
3
+ size 4954003424
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d45949b3046fc6ca55fab57f36925372d7fb88b068b8fdc2acfc364adaa8b935
3
+ size 4477392192
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_L-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:761b6157028b72141c480d65fe75783db0cb9aad8c0d12951cc29d2565e698fc
3
+ size 3071789856
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfcd1e3a090d99757a74d1df2510a09aecd27a4d981e60c1ef8adc38bb1f262d
3
+ size 4939099392
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6a02409fb4444b14f646472b433984515601ec8b807d9d5425f5f23395ac67a
3
+ size 4919925184
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9822811547fc18e07d4e332554000bd31c9e275bec717e95ddb0c889c144a67c
3
+ size 4919925184
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:066cf3d3b47bd9a82b62493bc7aaa25d965cc34a39a20c74cf2463aa5162b143
3
+ size 4919925184
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8790dfb9f327c1daaa783847f8e3ef65bd22bfdcac4d01e5691a0593f5e5f34
3
+ size 4919925184
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c026ae681f27f956943547982890151e6f07fb4a09a806140dd14eeb52fbfbda
3
+ size 4919925184
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_M-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:120a03437713e70d46e5fbb7a4bbf965e8b4814c723099c4123106bef9af7ea4
3
+ size 4728771904
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a14010fa69bfdd7cfe9d1d98987298163abc32628e13017689420f68fdd3ee6
3
+ size 4998869248
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d284c30e44519380c1b7bcab4b84000e851611f08670d3b0f398fb935547529
3
+ size 4938275904
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab91ece664fe1333643836bf72a8e2bf5e041c7c8cb79c4043d9ba40ec05c424
3
+ size 4947713312
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25d944cb32b9844ab6d574a2e76c2d868560e554ecf9db4a77dff99c3cb1370c
3
+ size 4909440000
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c24f45d795393cc8c69a217e00508ea4340040295e096dc01f867da02aad8b9
3
+ size 4938275904
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2108733fa512d2b78516bcd58d0c411d434a3536da692642417736162d2843c7
3
+ size 4901787552
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q3_K_S-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:016aad3802714f32e867cedf3683d6e51fcf844733ae4015deb098e2a14c163d
3
+ size 1277692000
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5260053e0c0386c1c1b79fad5e1c7d46a7a68d347615e5b661670e451a92147
3
+ size 4951500896
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af9541ed64f704dd0c7b8f838f722930111945a4c63b27202ade1cb377f9e490
3
+ size 4989490304
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e18f2940bc9bb35f2c929316e832889015809c25c883dd6bbd1ecc372ab0c63
3
+ size 4932801728
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aad172da96694d54c102dfcac6690c71112d092fbe5aef179708fc35d78b3440
3
+ size 4878112064
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8dff646fd4ac44f55065581c2c1f38bdd95732fca6ecc248ba9534efb30f2dc
3
+ size 4876997952
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d672b1d07387f30ef53ae66c8a8a65c6d67f1ec971a089079964c214eb5f1ce9
3
+ size 4965569728
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c5ed044cd16e2b751e7a7480e0261b22b069c76879a542b06d0473ac61f5389
3
+ size 4895052928
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b73e9bc38d00d186971f3b4fbfe0b7ef113cbf8663a04154dd6c82533953fc34
3
+ size 4486304480
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_M-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:632aee202234774220a5dd9620e1c65ff8ea5761998ad083308768aeeb954a3d
3
+ size 3544566560
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c1c6539dcc21424ac17e050834cf0984b62c99f6297b3ca84d13bb618bef586
3
+ size 4986628320
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82b27622a43013bba4a34a89d10ad6586b333995f31425d031a9d651ecb94aee
3
+ size 4990342688
deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-Q4_K_S-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72af884f802f335ca3c9f925cc6a1d642826dd71facd8e10cf0d990fd9fb9d30
3
+ size 4905408096