Activation scales for bloomz 7.1b
#1
by
bh4
- opened
The article at https://huggingface.co/blog/generative-ai-models-on-intel-cpu mentions that smoothquant was applied on bloomz 7b1 model also. But here, only smoothquant-scales for the 176b model is provided. Please add the smoothquant-scales for the 7b1 model also because many (like me) do not have the resources to run the 176b model.