Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
Llama-2-7B-Chat-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
llama
facebook
meta
llama-2
Model card Files Files and versions Community
36
Llama-2-7B-Chat-GGUF
Ctrl+K
Ctrl+K
  • 2 contributors
History: 10 commits
TheBloke's picture
TheBloke
Initial GGUF model commit (models made with llama.cpp commit bd33e5a)
cc10258 over 1 year ago
  • .gitattributes
    2.09 kB
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q2_K.gguf
    2.83 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q3_K_L.gguf
    3.6 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q3_K_M.gguf
    3.3 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q3_K_S.gguf
    2.95 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q4_0.gguf
    3.83 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q4_K_M.gguf
    4.08 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q4_K_S.gguf
    3.86 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q5_0.gguf
    4.65 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago
  • llama-2-7b-chat.Q5_K_S.gguf
    4.65 GB
    LFS
    Initial GGUF model commit (models made with llama.cpp commit bd33e5a) over 1 year ago