Hugging Face's logo

Lewdiculous
/
opus-v1.2-llama-3-8b-GGUF-IQ-Imatrix

GGUF
Inference Endpoints
conversational
Model card Files Community
Lewdiculous commited on
Commit
9db881b
·
verified ·
1 Parent(s): a0be2f2

Upload 13 files

Browse files
Files changed (13) hide show
  1. imatrix-with-rp-ex.txt +0 -0
  2. imatrix.dat +3 -0
  3. opus-v1.2-llama-3-8b-F16.gguf +3 -0
  4. opus-v1.2-llama-3-8b-IQ3_M-imat.gguf +3 -0
  5. opus-v1.2-llama-3-8b-IQ3_XXS-imat.gguf +3 -0
  6. opus-v1.2-llama-3-8b-IQ4_NL-imat.gguf +3 -0
  7. opus-v1.2-llama-3-8b-IQ4_XS-imat.gguf +3 -0
  8. opus-v1.2-llama-3-8b-Q4_K_M-imat.gguf +3 -0
  9. opus-v1.2-llama-3-8b-Q4_K_S-imat.gguf +3 -0
  10. opus-v1.2-llama-3-8b-Q5_K_M-imat.gguf +3 -0
  11. opus-v1.2-llama-3-8b-Q5_K_S-imat.gguf +3 -0
  12. opus-v1.2-llama-3-8b-Q6_K-imat.gguf +3 -0
  13. opus-v1.2-llama-3-8b-Q8_0-imat.gguf +3 -0
imatrix-with-rp-ex.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:185dd7533c9de51095879e74788b9c0031329a83a302452120b6c54b05ef90ba
3
+ size 4988126
opus-v1.2-llama-3-8b-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38d4db268452da3a7991752fef5ce78627a33a1f99925f937f21fd677e8ddd2e
3
+ size 16069403904
opus-v1.2-llama-3-8b-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6d45667a5220d9b08dd321e6c3b30a72acab336088418a716dae22bbc62f1d2
3
+ size 3785336128
opus-v1.2-llama-3-8b-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48ab6b99a61aee8967952d05d14f77ffb3c49104575401a6bea66960f5fde885
3
+ size 3275425088
opus-v1.2-llama-3-8b-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25d099b721bf3a5c3b193d109932984ed05ec5ca4c01156a99df9439b3468276
3
+ size 4678501696
opus-v1.2-llama-3-8b-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:622bd4b1c80b1e1dabd2f97715fabe941b8a2b15d731208b85690053e43cc9fd
3
+ size 4448175424
opus-v1.2-llama-3-8b-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:086c7944f96285b53146992d73d22d68da55c36be5732d8cc4632277bcbf9802
3
+ size 4921247040
opus-v1.2-llama-3-8b-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89b4128c08120a628e55457d6be4494fa16184452e5b52ac51077ff31d06944b
3
+ size 4693181760
opus-v1.2-llama-3-8b-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:653355ca30a6500e36d12ff8f5856d27d99335a5655b784b580cd021e37aeb34
3
+ size 5733500224
opus-v1.2-llama-3-8b-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56e25e3688d323b39476d62e15652b9a605d0462988ed231c6283a63af582c1b
3
+ size 5599806784
opus-v1.2-llama-3-8b-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8af4ae82dd007c2250a6a79e4b5b61f629916ee896a063fed541d48ccedabd0f
3
+ size 6596519232
opus-v1.2-llama-3-8b-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbdb59afa822c322c7eefff7d7c040e958ca64f5e65e14e16d4e87a0fa390396
3
+ size 8541283648