We're announcing our BananaMind 2.1 model series! The models will include: - BananaMind 2.1 Nano: 10M parameters with 60B tokens. - BananaMind 2.1 Lite: 25M parameters with 40B tokens. - BananaMind 2.1 Flash: 50M parameters with 55B tokens. - BananaMind 2.1 Pro: 135M-145M parameters (still deciding) with 100B tokens. These model will use a multi tower architecture (like BananaMind/BananaMind-2.1-Unified) with some more architectural changes.
BananaMind 2.1 Pro will probrably use 2 no output towers, instead of one!
We're currently training some experimental models based on this architecture to see its scaling!
We're excited to release BananaMind 2 Pro, our final version of the Pro model. Trained on 100B tokens it performs extremely good for its token and size class. The training took 22 days on one RTX 5070 Ti. Check it out at BananaMind/BananaMind-2-Pro We did not release a Chat version yet because it regressed. Release Later. Follow us to know when BananaMind 2 Ultra releases and support us at