Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
falcon-40b-instruct-GGML
like
58
Transformers
tiiuae/falcon-refinedweb
English
falcon
text-generation-inference
5 papers
License:
apache-2.0
Model card
Files
Files and versions
Community
5
Train
Deploy
Use this model
ggmlv3
falcon-40b-instruct-GGML
1 contributor
History:
29 commits
TheBloke
Update README.md
ef68241
11 months ago
.gitattributes
1.48 kB
initial commit
11 months ago
README.md
15.3 kB
Update README.md
11 months ago
config.json
28 Bytes
Add config.json for ctransformers
11 months ago
falcon40b-instruct.ggmlv3.q2_K.bin
13.7 GB
LFS
Add new GGMLv3 k-quant Falcon40B GGMLs
11 months ago
falcon40b-instruct.ggmlv3.q3_K_S.bin
18 GB
LFS
Add new GGMLv3 k-quant Falcon40B GGMLs
11 months ago
falcon40b-instruct.ggmlv3.q4_K_S.bin
23.5 GB
LFS
Add new GGMLv3 k-quant Falcon40B GGMLs
11 months ago
falcon40b-instruct.ggmlv3.q5_K_S.bin
28.8 GB
LFS
Add new GGMLv3 k-quant Falcon40B GGMLs
11 months ago
falcon40b-instruct.ggmlv3.q6_K.bin
34.3 GB
LFS
Add new GGMLv3 k-quant Falcon40B GGMLs
11 months ago
falcon40b-instruct.ggmlv3.q8_0.bin
44.5 GB
LFS
Add new GGMLv3 k-quant Falcon40B GGMLs
11 months ago