TheBloke
/

falcon-40b-instruct-GGML

Model card Files Files and versions Community

falcon-40b-instruct-GGML

1 contributor

History: 14 commits

TheBloke's picture

Add new GGMLv3 k-quant Falcon40B GGMLs

7def927 over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
README.md

13.6 kB

Update README.md over 1 year ago
falcon40b-instruct.ggmlv3.q2_K.bin

13.7 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q3_K_L.bin

18 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q3_K_M.bin

18 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q3_K_S.bin

18 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q4_K_M.bin

23.5 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q4_K_S.bin

23.5 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q5_K_M.bin

28.8 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q5_K_S.bin

28.8 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q6_K.bin

34.3 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago
falcon40b-instruct.ggmlv3.q8_0.bin

44.5 GB
LFS

Add new GGMLv3 k-quant Falcon40B GGMLs over 1 year ago