Hugging Face's logo

MaziyarPanahi
/
Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
text-generation-inference
Model card Files Community
10
MaziyarPanahi commited on
Commit
a5dea8b
•
1 Parent(s): 89b0f4d

[WIP] Upload folder using huggingface_hub (multi-commit 2dbd84356136abde101a847c0c5743bfb77dd4534d055b863c10307a708e4f6f) (#3)

Browse files

- ebc61fe73d61f05af8d594e5e0df5feec38a0fad99adde71ca1d6d84583c65a2 (755cd8dc7a1b644f1e57a49fb937d60b72986573)
- 759811fd2ac3ccf5e4c789308e6f69711f2ade894bf3e7bf33ef71c5da6b2190 (4021b03e9929dd91e29c4a25a40d1112267e5150)
- 691955792338e5d76f37d872140a5675d286059eab45762a25daabf7faa551ab (623bb36ce1bae67c50108279bc9a4a4fdd1e091b)
- d172b1a70957b02cb4671b26aa8b79ef687255ce98379111d42392522cacd4a1 (135e98fcc7129569b175e9b8b6862585596fdf9d)
- 6115a082ff8a79d4b094b789b61f05088f240c1b7083317064fa8b376224724f (09e92792ee2d1dd8f097b32880e677d84e83a3ea)
- 2ed8b030c10528d705beea8ade19f811a3bded001c7e21e51b0899d62fb21e74 (2ed949d9b6fdc951892c0c6bf7ecfc8d047043be)
- 2cfde341c9bfc4ccd7257991cf964392e60a86c72bbc895ad4fed4ec44ba1e2c (a71b131727ac8f7bd8aedfd7256f856393852c3a)
- d70e0099ad7195b6f35eb656d989a138968672b118fef1328666bd74d94307a2 (c3ec9b0c8f26be0e2e22f90c305dc466299be3c3)
- d7060344348b93bd749e7378fd22dd8a6a6411a779f935ecef19fe256dd142bd (90af6c6db7068ce354d2ff8751c5929e6a6cf78f)
- 9fc4700b2e223b9263327e2667aa585653592f3f071fb94f7ddaf46bb8f6d838 (c4d992b08474280fe6d9ba3e8e530c5ed4938307)

Files changed (10) hide show
  1. Llama-3-8B-Instruct-32k-v0.1.Q2_K.gguf +1 -1
  2. Llama-3-8B-Instruct-32k-v0.1.Q3_K_L.gguf +1 -1
  3. Llama-3-8B-Instruct-32k-v0.1.Q3_K_M.gguf +1 -1
  4. Llama-3-8B-Instruct-32k-v0.1.Q3_K_S.gguf +1 -1
  5. Llama-3-8B-Instruct-32k-v0.1.Q4_K_M.gguf +1 -1
  6. Llama-3-8B-Instruct-32k-v0.1.Q4_K_S.gguf +1 -1
  7. Llama-3-8B-Instruct-32k-v0.1.Q5_K_M.gguf +1 -1
  8. Llama-3-8B-Instruct-32k-v0.1.Q5_K_S.gguf +1 -1
  9. Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf +1 -1
  10. Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf +1 -1
Llama-3-8B-Instruct-32k-v0.1.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1d7295cc6711389c49e675bcfcb59a8b2d58233f4d4ddd3d855ec0217dba6fcd
3
  size 3179131136
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e8c706b71e7e98d75d1c29b429c13a7e7cc58b71ae07f666f8a4c601345d60f
3
  size 3179131136
Llama-3-8B-Instruct-32k-v0.1.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee0b97c4c323ac9c126a5de41d97d7e0a2b36d66cf8d9fca31675dcb43b50ded
3
  size 4321956096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d63f1d2674d00c153c9e63e7ad3b522a7313e0eae15ce329f6ceb7962ec7fb6
3
  size 4321956096
Llama-3-8B-Instruct-32k-v0.1.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3330aeb8178e3079df85958b9ae81b0c941962664301edc88781c3d900a1a700
3
  size 4018917632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17e585ae4c781a702d153877671e1a7d539d2d479a38a94c47d90c46b3a6dc62
3
  size 4018917632
Llama-3-8B-Instruct-32k-v0.1.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8a0b4d71710c758d9af6add267d936b86aa83f0b2d09b47913b6462bbd346fa5
3
  size 3664498944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:936fa80bddcb92beb11a9efe2c3fe1ea07923c9061c2bb21989c8e30d7daf5da
3
  size 3664498944
Llama-3-8B-Instruct-32k-v0.1.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:32e4a358d92f8005f28fde76bf01afa5eb0ade29c123eb6131424d72001c772f
3
  size 4920733952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9785b690c70160cc595b2176c9ee84dab89b139f627d09ea52286484f13c3b0
3
  size 4920733952
Llama-3-8B-Instruct-32k-v0.1.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2ae7654257907fd4693c6540941863cc15701f27d2c895f51f0d4d64d536001e
3
  size 4692668672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdf0b7c6cafd5a0ae7e7d7e021228b83b6cf1e59526406a6f3acf0fdf6fad93e
3
  size 4692668672
Llama-3-8B-Instruct-32k-v0.1.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b0d2cc5bbe727f427d159cb8ae4a004f59d0d56b73e9abd95f80915c8a535f5b
3
  size 5732987136
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6851e1e2648475192766596799568b2a89faca9ac645e2d27cca84ba87b446ec
3
  size 5732987136
Llama-3-8B-Instruct-32k-v0.1.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1830183332015ef51500526c68ce6124d1c599dca06139240bfdc7283b521c94
3
  size 5599293696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:989216257647920e388b17922b73f990d9c63e464492dd9eb55f4e76968e9df7
3
  size 5599293696
Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e7c7e8a8d8af1d180366d455a9611e3fa633815922629be10f3ba2c190e16eb0
3
  size 6596006144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05d00998b0a2f6a678e363dd3cda64284a1a54233e44a69976a62b92ca7072af
3
  size 6596006144
Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a178e0f1d82da857cbc168eb7ae2932d910002771a1f14d6bcf10c98cb1d304c
3
  size 8540770560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e5933f73b784f48320f69d1312f967e5211de0ec941bd1985134e1c6b9244bb
3
  size 8540770560