Model card parameters
#8
by
amartino
- opened
Why does the model card list the number of parameters as 24.7B params? Does this model not contain all 180B params (quantized) from the original Falcon-180B model?
Not sure, that's an automated Hugging Face process that adds that indicator, and I don't know if it's guaranteed to be correct for quantised models.
It does have the original 180B parameters, quantised. But possibly they're stored in a different way, that makes it appear like there's fewer? Sorry, I'm a bit hazy on the technical details of how the model is stored once quantised. Or it might just be that the indicator is incorrect for quantised models, mis-reading the structure.
But yes, it's definitely the whole model!