Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

akumaburn
/
llama-3-8b-bnb-4bit-GGUF

Transformers
GGUF
English
llama
text-generation-inference
unsloth
Model card Files Files and versions Community
llama-3-8b-bnb-4bit-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 17 commits
akumaburn's picture
akumaburn
(Trained with Unsloth)
e227d44 verified about 1 year ago
  • .gitattributes
    2.08 kB
    (Trained with Unsloth) about 1 year ago
  • README.md
    659 Bytes
    Update README.md about 1 year ago
  • config.json
    29 Bytes
    (Trained with Unsloth) about 1 year ago
  • llama-3-8b-bnb-4bit-GGUF-unsloth.F16.gguf
    16.1 GB
    LFS
    (Trained with Unsloth) about 1 year ago
  • llama-3-8b-bnb-4bit-GGUF-unsloth.Q2_K.gguf
    3.18 GB
    LFS
    (Trained with Unsloth) about 1 year ago
  • llama-3-8b-bnb-4bit-GGUF-unsloth.Q3_K_M.gguf
    4.02 GB
    LFS
    (Trained with Unsloth) about 1 year ago
  • llama-3-8b-bnb-4bit-GGUF-unsloth.Q4_K_M.gguf
    4.92 GB
    LFS
    (Trained with Unsloth) about 1 year ago
  • llama-3-8b-bnb-4bit-GGUF-unsloth.Q5_K_M.gguf
    5.73 GB
    LFS
    (Trained with Unsloth) about 1 year ago
  • llama-3-8b-bnb-4bit-GGUF-unsloth.Q6_K.gguf
    6.6 GB
    LFS
    (Trained with Unsloth) about 1 year ago
  • llama-3-8b-bnb-4bit-GGUF-unsloth.Q8_0.gguf
    8.54 GB
    LFS
    (Trained with Unsloth) about 1 year ago