TheBloke
/

LLaMa-65B-GGML

text-generation-inference

Model card Files Files and versions Community

1 contributor

History: 15 commits

TheBloke's picture

Upload LLaMa 65B GGML, all quant formats.

b3b27ca about 1 year ago

.gitattributes

1.48 kB

initial commit about 1 year ago
README.md
8.53 kB

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
config.json

27 Bytes

Add config.json for ctransformers about 1 year ago
llama-65b.ggmlv3.q2_K.bin

27.3 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q3_K_L.bin

34.5 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q3_K_M.bin

31.4 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q3_K_S.bin

28.1 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q4_0.bin

36.7 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q4_1.bin

40.8 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q4_K_M.bin

39.3 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q4_K_S.bin

36.7 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q5_0.bin

44.9 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q5_1.bin

49 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q5_K_M.bin

46.2 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago
llama-65b.ggmlv3.q5_K_S.bin

44.9 GB
LFS

Upload LLaMa 65B GGML, all quant formats. about 1 year ago