| # Advanced FastText Modification | |
| colab:https://colab.research.google.com/drive/1apd0UFutEqBMG_7t_60QJAoxWxNdc1yr#scrollTo=GayYJ9VeJms7 | |
| ## Overview | |
| This software is an **innovative version of FastText**, optimized to use its classification system for **fast and efficient word prediction**. With capabilities that can surpass modern language models, it delivers exceptional performance. | |
| ## Model Training | |
| - **Data Used:** The models were trained with more than **20,000 question and answer (QA) interactions** from the **Wizard Evo instruct** dataset. | |
| - **Focus on Dynamic Learning:** This approach guarantees in-depth understanding in contexts of dialogue and interaction. | |
| ## Processing Capacity | |
| - **Speed:** 800 tokens/thread/second. | |
| - **Performance on Common Hardware:** On a notebook with 16 threads, the program processes approximately **50 billion tokens per hour**. | |
| ## Learning and Testing | |
| - **Learning:** Evidence points to an ability to **learn robustly**. | |
| - **Testing:** The software is still in the early testing phases, but preliminary results are promising. | |
| --- | |
| This project is constantly evolving and we welcome any feedback or contributions from the community! |