view post Post 3756 Folks, let's get ready.🥳 We will be busy soon. 😅🤗https://github.com/huggingface/transformers/pull/36878 See translation 🔥 16 16 🤯 6 6 🚀 4 4 🤗 3 3 + Reply
view post Post 7236 📢 New Research Alert: Making Language Models Smaller & Smarter!Thrilled to share the latest technical report demonstrating how to reduce language model parameters by 77% while maintaining performance. The secret? Grouped pointwise convolutions. Yes. We brought a method from computer vision to the transformers arena.🔑 Key Findings:• 77% parameter reduction.• Maintained model capabilities.• Improved generalization.Paper: https://www.researchgate.net/publication/388835829_SAVING_77_OF_THE_PARAMETERS_IN_LARGE_LANGUAGE_MODELS_TECHNICAL_REPORTCode: https://github.com/joaopauloschuler/less-parameters-llm See translation 2 replies · 👍 19 19 🔥 8 8 🤯 3 3 🚀 2 2 🧠 1 1 + Reply