TheBloke
/

Llama-2-7B-Chat-GGML

Text Generation

text-generation-inference

Model card Files Files and versions Community

Llama-2-7B-Chat-GGML

3 contributors

History: 18 commits

TheBloke's picture

Initial GGML model commit

606aca4 about 1 year ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

10.6 kB

Initial GGML model commit about 1 year ago
config.json

29 Bytes

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q2_K.bin

2.87 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q3_K_L.bin

3.6 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q3_K_M.bin

3.28 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q3_K_S.bin

2.95 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q4_0.bin

3.79 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q4_1.bin

4.21 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q4_K_M.bin

4.08 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q4_K_S.bin

3.83 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q5_0.bin

4.63 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q5_1.bin

5.06 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q5_K_M.bin

4.78 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q5_K_S.bin

4.65 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q6_K.bin

5.53 GB
LFS

Initial GGML model commit about 1 year ago
llama-2-7b-chat.ggmlv3.q8_0.bin

7.16 GB
LFS

Initial GGML model commit about 1 year ago