Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3-8B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
mistral
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
text-generation-inference
Model card Files Community
20
MaziyarPanahi commited on
Commit
a1bb52d
•
1 Parent(s): b3340de

Upload folder using huggingface_hub (#18)

Browse files

- ee170b5e81092b580bf15a3b208b46c5e5069357dd8f123cfdac8c9954d41cbe (c63b8e1a291de9d5130cc50783f4e6664651f33f)
- fbbbeadc998c910cb7a52f4f53264e2c76fb3244adc5bc4f1d27398c1c975f50 (8e6679bbcfaa1782da2e8eb81ccba521a3ba1c94)
- 2c9af4a64977d5fd99de81e2779f6010163405a3909a3f356d82981dfce7e322 (aefe8ccd5ab5d5f98ccae8b75284a8522ac70c5b)
- ae1deddc1f5707fb31eda579757c079a056d34d116c10a2d58928994adfc886a (e6bdc76bb5334580b945a6bdded046691e560690)
- dcee0cbec4c1239d761ddaf91f2d6f340184664ca0920a77d921c484bc0c687f (c52bd2ebce172933b65604fa1a1add772ca66c27)
- 9395938102cf8bf7be5e9cf30288c7969655d2d52344ac38ea7ae5f23c351e10 (ef7cb12a9643c4e33ab38e32fcd738278fd99113)
- 0135bcf2e7428616aaa80c943c1b416b87476ed9c269662cbbd3b8288e5c8835 (b0bf95ce8ac250a03e934e17190b49e0ae04fc48)
- de37ec535a8b811dbd4fdcad08307df6f915399493dd0d92dee35d1e1801a545 (da89085bac6fae671b64d7c5bad9b2ffccf10fd2)
- aa842c06a4f41479ac70c60f2608ee540efb66eddb8aaad74c8650b580a72ca0 (c9fa4fb767fb9e704fa87a733079196c0f451947)
- ce1753ff7c960164f5fad8e0fe3a4c48f6c10f2f299554d5f9ee802aeaa78e39 (f97eb2f821d205ebe48d60bbac0d058e91fcf55c)
- dcef90de2a5792535e08aca8d469c4964da282df93d39dbe244c84f95551a202 (47ac684bb176cda608df2dba560f5c5a3bd4ee86)
- e226118fc74bd461da35a25115cf85f86cecb6c8c24e834d48b2eb75c133e594 (70e838cfb496e88c8d2941f9575fa14298071a75)
- f8850e27a0a5f292dd25a9f9f5d99655f7513ac21508fed72abf6ead6a418891 (ca2a2c4b99f2dfa367874f6ef6be31efd66baf21)
- 528b0ba622db4b4805444edcc70d96652e445f8565eda10c9fcb085a4614fadb (9b7eaefb32de0aae711373b911b8550f51449e39)
- 8d6815053b61d809c9dcd8d3cf15fd6efbccf86b1e5c85974bf23a4577204143 (fce39d3aaf98e1b8a53468f8ffb33f9736b39160)

Files changed (15) hide show
  1. Meta-Llama-3-8B-Instruct.IQ1_M.gguf +1 -1
  2. Meta-Llama-3-8B-Instruct.IQ1_S.gguf +1 -1
  3. Meta-Llama-3-8B-Instruct.IQ2_XS.gguf +1 -1
  4. Meta-Llama-3-8B-Instruct.IQ3_XS.gguf +1 -1
  5. Meta-Llama-3-8B-Instruct.IQ4_XS.gguf +1 -1
  6. Meta-Llama-3-8B-Instruct.Q2_K.gguf +1 -1
  7. Meta-Llama-3-8B-Instruct.Q3_K_L.gguf +1 -1
  8. Meta-Llama-3-8B-Instruct.Q3_K_M.gguf +1 -1
  9. Meta-Llama-3-8B-Instruct.Q3_K_S.gguf +1 -1
  10. Meta-Llama-3-8B-Instruct.Q4_K_M.gguf +1 -1
  11. Meta-Llama-3-8B-Instruct.Q4_K_S.gguf +1 -1
  12. Meta-Llama-3-8B-Instruct.Q5_K_M.gguf +1 -1
  13. Meta-Llama-3-8B-Instruct.Q5_K_S.gguf +1 -1
  14. Meta-Llama-3-8B-Instruct.Q6_K.gguf +1 -1
  15. Meta-Llama-3-8B-Instruct.Q8_0.gguf +1 -1
Meta-Llama-3-8B-Instruct.IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:886bf0c6349f932eae9f1e3c686bf16adac5595917d482619cb9b164cac02b7e
3
  size 2162484448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d2b981d2d3ff8b76c40c25b30d16e23683986a81b3fae394979c5f12d8987ac
3
  size 2162484448
Meta-Llama-3-8B-Instruct.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:128dab50191c78d4c6a8a79e5d30ea88f2660f9baa9f04e011f7dbf438928c57
3
  size 2020140256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a35d34a9f9ce5372192bba69f8637df55375ebcbfcba9594edb2a2b8a415b93
3
  size 2020140256
Meta-Llama-3-8B-Instruct.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:218a8653c8d5fa5ad38fbf59130087da043596f40abc35f49339069d5f14adfc
3
  size 2606294240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d994b4285ddac4e00f69e36aacf9a84a7f3f9e6679508c3baecf8a1d35503e10
3
  size 2606294240
Meta-Llama-3-8B-Instruct.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:94962d23cce8a147584bd7334963ec3882f92ddc6010525286ab1698beba233b
3
  size 3519259872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d62fbd5cba536b03e45dc82a78fc9ac33c979129a3d386422b127bc7085af8b6
3
  size 3519259872
Meta-Llama-3-8B-Instruct.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c55043630605bbd95d82976c0de10e61d740338fb25f6ca59b7ba138a42e3ce5
3
  size 4448175328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f38c59ec1abcd428d2c3ab2c9c63798c2aeac5bbdf3e708f4998a69ac50dfba1
3
  size 4448175328
Meta-Llama-3-8B-Instruct.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9a564e4020cbaa28faec8f247ab12226eb160e1d6489aa05c35a0cfeb20f902e
3
  size 3179644128
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc6f3ac3758ac698bad1cadaf98e6cf0dcf28ea0d7b5111379378882ce7a8be2
3
  size 3179644128
Meta-Llama-3-8B-Instruct.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d70ee06ade813f391aba2e9417044b1702c6aac9b9ba3ec15caf5cf8c7831fc4
3
  size 4322469088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e68e1867c60526f2b4664850a53db1cf469af8e1d0e7fc055c2ed2db7190582b
3
  size 4322469088
Meta-Llama-3-8B-Instruct.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fc9c49f555a50fd528e0b7db6b5d7037de391c520ecc6a1d1cf0b886cb5d75ff
3
  size 4019430624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c48b75dcb6ffda0f1d8225b2313f86860ded09703731a27e8b924faf5b621cb
3
  size 4019430624
Meta-Llama-3-8B-Instruct.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0654ac8e6dcd17b9ba11172c7919c2ff961f1ac62e7c5ac05e1d052925071466
3
  size 3665011936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f79b99ba3f2b666b0527591622a18a4d2a06b186f86ae82d123bfe86bf2d2b80
3
  size 3665011936
Meta-Llama-3-8B-Instruct.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b00210329b64e27072b26a2e04ab2c87bdc7319b4963c3a41f91e1ad5ad13094
3
  size 4921246944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4903067381e3753e2629f9d20c52df0e43b675bed2735bc3efea351c7d07454d
3
  size 4921246944
Meta-Llama-3-8B-Instruct.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:92402603e7e0caafe93ea529399a24180c904940645b341f041dd7e68199195a
3
  size 4693181664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5eddeeb4b46b88cedf0a30ff3769cbf9167785cbbb4b336aa13347f0c94f1b3c
3
  size 4693181664
Meta-Llama-3-8B-Instruct.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63083796fd9db7146f26f3f72391ab44cb50d7e7c68e358d0a5518416c388be5
3
  size 5733500128
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:740c575a3ceb1f1be4031797feee415db9b0595d88c5a7a18a83d9a1d741dbd7
3
  size 5733500128
Meta-Llama-3-8B-Instruct.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bfea7a3b0a3e56b90d2c27d42798678f1019d9e35997fb1f7978f5fb31ef5ef
3
  size 5599806688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d183c51c016730d1d3a501a3208c21ea8fc0c5f9856845294faf4819993579b
3
  size 5599806688
Meta-Llama-3-8B-Instruct.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f99b633f92be9d45bb5bc6816dec05fa92dcbf1678520fbc775477e544979d6e
3
  size 6596519136
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2ca99d853de276fb25a13e369a0db2fd3782eff8d28973404ffa5ffca0b9267
3
  size 6596519136
Meta-Llama-3-8B-Instruct.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a663dedd14ce0b19255ec907800e1e15963b7465e8183616623b9e8cb6372f3b
3
  size 8541283552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7efa06c16dc522fe7e6a48e36d17cc42dcadfe581ae1cdf7be9f51734eaf85d
3
  size 8541283552