Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
yichunkuo
/
falcon-rw-1b-gptq
like
0
Text Generation
Transformers
Safetensors
falcon
custom_code
text-generation-inference
Inference Endpoints
8-bit precision
gptq
License:
cc-by-4.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
c654b13
falcon-rw-1b-gptq
/
README.md
yichunkuo
Update README.md
c654b13
10 months ago
preview
code
|
raw
Copy download link
history
blame
No virus
476 Bytes
metadata
license:
cc-by-4.0
GPTQ quantized falcon-rw-1b
Branch
Bits
GS
Act Order
Damp %
GPTQ Dataset
Seq Len
Size
ExLlama
Desc
main
8
None
No
0.01
c4
2048
--
No
8-bit, without Act Order and no grouop size.