Hugging Face's logo

MarsupialAI
/
Llama3_GGUF_Quant_Testing

GGUF
Inference Endpoints
conversational
Model card Files Community
MarsupialAI commited on
Commit
6376837
•
1 Parent(s): 828da3b

Upload 2 files

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. imat_testing/L38ablit_fp16.gguf +3 -0
  3. imat_testing/L38ablit_fp32.gguf +3 -0
.gitattributes CHANGED
@@ -51,3 +51,5 @@ imat_testing/L38ablit_fp32_imat8_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
51
  imat_testing/L38ablit_fp32_Q4.gguf filter=lfs diff=lfs merge=lfs -text
52
  imat_testing/L38ablit_fp32_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
53
  imat_testing/L38ablit_fp32_Q8.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
51
  imat_testing/L38ablit_fp32_Q4.gguf filter=lfs diff=lfs merge=lfs -text
52
  imat_testing/L38ablit_fp32_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
53
  imat_testing/L38ablit_fp32_Q8.gguf filter=lfs diff=lfs merge=lfs -text
54
+ imat_testing/L38ablit_fp16.gguf filter=lfs diff=lfs merge=lfs -text
55
+ imat_testing/L38ablit_fp32.gguf filter=lfs diff=lfs merge=lfs -text
imat_testing/L38ablit_fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c95493163bb08d541df41d0afb79c256888b8d029f95128f264e173d1d059b4d
3
+ size 16068890848
imat_testing/L38ablit_fp32.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:562bab22b2594baf503789a371311a4b452ed2941fd73f50772bf76712f8ae83
3
+ size 32128880864