TheBloke
/

Falcon-7B-Instruct-GGML

text-generation-inference

Model card Files Files and versions Community

Falcon-7B-Instruct-GGML

1 contributor

History: 24 commits

TheBloke's picture

Rename falcon-7b-instruct.ggmlv3.q5_1.bin to falcon-7b-instruct.ggccv1.q5_1.bin

f91c9ab about 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md
15.4 kB

Initial GGCC model commit about 1 year ago
config.json

28 Bytes

Add config.json for ctransformers over 1 year ago
falcon-7b-instruct.ggccv1.q4_0.bin
4.06 GB
LFS

Rename falcon-7b-instruct.ggmlv3.q4_0.bin to falcon-7b-instruct.ggccv1.q4_0.bin about 1 year ago
falcon-7b-instruct.ggccv1.q4_1.bin
4.51 GB
LFS

Rename falcon-7b-instruct.ggmlv3.q4_1.bin to falcon-7b-instruct.ggccv1.q4_1.bin about 1 year ago
falcon-7b-instruct.ggccv1.q5_0.bin
4.96 GB
LFS

Rename falcon-7b-instruct.ggmlv3.q5_0.bin to falcon-7b-instruct.ggccv1.q5_0.bin about 1 year ago
falcon-7b-instruct.ggccv1.q5_1.bin
5.41 GB
LFS

Rename falcon-7b-instruct.ggmlv3.q5_1.bin to falcon-7b-instruct.ggccv1.q5_1.bin about 1 year ago
falcon-7b-instruct.ggmlv3.q8_0.bin
7.67 GB
LFS

Initial GGCC model commit about 1 year ago