Is this model still being used in production?
#65
by xianbao - opened
Dear Team,
Thanks a lot for the amazing work on Bloom. I still look back often on all those exciting days!
As part of our ongoing efforts to keep the vLLM codebase clean and maintainable, we are currently reviewing older architectures to see if they are still actively used. We wanted to check in with you to see what the current usage looks like for Bloom.
If it's no longer used by vLLM users, we are considering removing the implementation from vLLM and transitioning it to the Transformers fallback. This way, the model can still remain fully functional for anyone who needs it, while allowing us to streamline the core repository.
We'd love to get your thoughts and alignment on this. Let us know what you think!
Best regards,
Tiezhen