Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
duyntnet
/
bloom-3b-imatrix-GGUF
like
0
Text Generation
Transformers
GGUF
English
imatrix
bigscience
bloom-3b
License:
other
Model card
Files
Files and versions
Community
Train
Deploy
Use in Transformers
Edit model card
From original readme
Quantizations of
https://huggingface.co/bigscience/bloom-3b
From original readme
...
Downloads last month
5,867
GGUF
IQ1_S
IQ2_S
IQ2_XS
IQ2_XXS
IQ3_S
IQ3_XXS
IQ4_NL
IQ4_XS
Q2_K
Q2_K
Q3_K
Q3_K
Q3_K
Q4_0
Q4_K
Q4_K
Q5_0
Q5_K
Q5_K
Q6_K
Q8_0
+4
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.
Maximize
