Hugging Face's logo

Lewdiculous
/
Llama-3.1-8B-ArliAI-Formax-v1.0-GGUF-IQ-ARM-Imatrix

GGUF
English
roleplay
rp
sillytavern
Inference Endpoints
imatrix
conversational
Model card Files Community
Lewdiculous commited on
Commit
74b2609
•
1 Parent(s): 3565d87

quants

Browse files
Files changed (12) hide show
  1. .gitattributes +11 -0
  2. ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_4_4-imat.gguf +3 -0
  3. ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_4_8-imat.gguf +3 -0
  4. ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_8_8-imat.gguf +3 -0
  5. Llama-3.1-8B-ArliAI-Formax-v1.0-IQ3_XXS-imat.gguf +3 -0
  6. Llama-3.1-8B-ArliAI-Formax-v1.0-IQ4_XS-imat.gguf +3 -0
  7. Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf +3 -0
  8. Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_S-imat.gguf +3 -0
  9. Llama-3.1-8B-ArliAI-Formax-v1.0-Q5_K_M-imat.gguf +3 -0
  10. Llama-3.1-8B-ArliAI-Formax-v1.0-Q5_K_S-imat.gguf +3 -0
  11. Llama-3.1-8B-ArliAI-Formax-v1.0-Q6_K-imat.gguf +3 -0
  12. Llama-3.1-8B-ArliAI-Formax-v1.0-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  Llama-3.1-8B-ArliAI-Formax-v1.0-BF16.gguf filter=lfs diff=lfs merge=lfs -text
38
  Llama-3.1-8B-ArliAI-Formax-v1.0-F16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  Llama-3.1-8B-ArliAI-Formax-v1.0-BF16.gguf filter=lfs diff=lfs merge=lfs -text
38
  Llama-3.1-8B-ArliAI-Formax-v1.0-F16.gguf filter=lfs diff=lfs merge=lfs -text
39
+ ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_4_4-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_4_8-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_8_8-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Llama-3.1-8B-ArliAI-Formax-v1.0-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Llama-3.1-8B-ArliAI-Formax-v1.0-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Llama-3.1-8B-ArliAI-Formax-v1.0-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Llama-3.1-8B-ArliAI-Formax-v1.0-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Llama-3.1-8B-ArliAI-Formax-v1.0-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Llama-3.1-8B-ArliAI-Formax-v1.0-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_4_4-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae895150d07f4a9171ae239994a11b530ee0930f9639003010b087b8d1bdb7da
3
+ size 4661212224
ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_4_8-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:132f5153dc5ce8122ebad67794c3060454f4efb59eeb0abeb2d70ecb3b08efef
3
+ size 4661212224
ARM_Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_0_8_8-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a83d6ef3861377b498f7f42425792cf9bb2c66235d83ea7471e6ff6b2836178
3
+ size 4661212224
Llama-3.1-8B-ArliAI-Formax-v1.0-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ae39b6c5eaa7faeca4c19a42337c679f88ef6b3fb714408aa44ed51559af7c3
3
+ size 3274912832
Llama-3.1-8B-ArliAI-Formax-v1.0-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04affecb6fc5015f61d908c61c450d187337e3cdeea9e4f9800baf0cd3b0ee72
3
+ size 4447663168
Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b548ad47caf7008a697afb3556190359529f5a05ec0e4e48ef992c7869e14255
3
+ size 4920734784
Llama-3.1-8B-ArliAI-Formax-v1.0-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c4dc7e97da297f85f056396913edab759ed0289f9226c21c970561fee163a66
3
+ size 4692669504
Llama-3.1-8B-ArliAI-Formax-v1.0-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17bf67398bc6fb333d1adfa87106dfab3359d14d50c80b6d40d01d313eab70df
3
+ size 5732987968
Llama-3.1-8B-ArliAI-Formax-v1.0-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:996d9c41309aaa53b12a9cd497bb0bf6477a0c01583d16bcf7eeacf715e98a39
3
+ size 5599294528
Llama-3.1-8B-ArliAI-Formax-v1.0-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19c3188ad3bd8ba077e31c35f662bc4615c195aded009d64d13c4cd1114dda25
3
+ size 6596006976
Llama-3.1-8B-ArliAI-Formax-v1.0-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32f1c0eaff13fa47195cdcee729662fdd60c4cb76ce9195b4e8db4e6bb974edd
3
+ size 8540771392